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FOREWORD 


This  report  describes  selected  aspects  of  the  second  year  work  effort  under  the  Science 
and  Technology  Objective  (STO)  entitled  Virtual  Environments  for  Dismounted  Soldier 
Simulation,  Training,  and  Mission  Rehearsal.  The  U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences  (ARI)  Infantry  Forces  Research  Unit  performed  this  research  in 
collaboration  with  the  ARI  Simulation  Systems  Research  Unit,  the  U.S.  Army  Simulation, 
Training,  and  Instrumentation  Command,  and  the  U.S.  Army  Research  Laboratory.  The  primary 
objective  of  the  STO  was  to  address  selected  technological  and  training  issues  related  to  high 
fidelity  dismounted  soldier  simulation. 

This  report  describes  a  preliminary  research  effort  that  examined  the  utility  of  virtual 
environments  for  training  small  unit  dismounted  infantry  leader  (platoon  level)  decision-making 
skills  in  simulated  urban  operations.  The  training  was  evaluated  at  the  Dismounted  Battlespace 
Battle  Lab  (DBBL)  Land  Warrior  Test  Bed,  Fort  Benning,  Georgia.  The  research  identifies 
possible  solutions  for  enhancing  virtual  environment  decision  skills  training.  By  incorporating 
virtual  environment  technologies  in  training,  soldiers  are  able  to  develop  the  cognitive 
framework  needed  for  effective  decision-making  at  reduced  cost  to  the  xmit  in  training  time 
and/or  actual  expense.  Critical  aspects  of  the  research  were  briefed  to  all  key  STO  participants 
including  the  Chief  of  the  DBBL  Simulation  Center,  at  separate  STO  meetings  on  2  March,  22 
June,  and  14  November  2000. 


OTA  M.  SIMUTIS 
Technical  Director 
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TRAINING  AND  ASSESSMENT  OF  DECISION-MAKING  SKILLS  IN  VIRTUAL 
ENVIRONMENTS 

EXECUTIVE  SUMMARY 


Research  Requirements: 

Small  unit  leaders  (platoon,  squad,  team)  must  be  capable  of  taking  effective  independent 
actions  across  an  increasingly  diverse  range  of  military  missions.  They  must  be  prepared  to  deal 
with  a  complex  urban-oriented  battlefield  that  could  change  in  scope  and  lethality  without 
warning.  Critical  to  the  unit’s  success  is  the  leader’s  ability  to  recognize  environmental  cues  and 
relevant  situational  factors,  maintain  situation  awareness  (SA),  apply  appropriate  strategies,  and 
make  effective  real-time  decisions.  Conducting  the  appropriate  cognitive  skills  training  at  real- 
world  urban  training  sites  can  be  extremely  costly.  One  solution  is  to  conduct  a  portion  of  this 
training  in  virtual  environments  through  the  use  of  individual  combatant  simulators.  The  present 
research  combined  both  basic  and  applied  research  objectives.  The  primary  objectives  were: 

•  Determine  the  effectiveness  of  using  a  virtual  environment  to  train  real  world  decision¬ 
making  skills. 

•  Determine  the  feasibility  of  using  a  virtual  environment  as  a  test  bed  for  developing  SA 
measurement  instruments. 

•  Empirically  assess  the  role  of  SA  in  decision-making  in  simulated  dismounted  infantry 
environments. 

Procedure: 

Seven  experienced  and  seven  inexperienced  officers,  role-playing  a  dismounted  infantry 
platoon  leader,  individually  conducted  four  urban  operation  scenarios  (missions)  in  a  virtual 
environment  setting.  Scenarios  included  built-in  decision  points  that  required  the  officer  to  take 
specific  actions  at  each  point.  Decision-making  capability  and  SA  were  assessed  for  each 
mission.  In  addition,  soldier  responses  to  the  training  and  the  simulation  systems  were  obtained 
at  the  conclusion  of  the  experiment. 

Findings: 

Objective  decision-point  accuracy  improved  significantly  over  missions.  The  officers’ 
level  of  experience  did  not  impact  the  rate  of  learning.  Experience  did  play  a  significant  role  in 
SA  assessments.  Selected  SA  measures  also  predicted  a  significant  portion  of  the  variance  in 
objective  decision-point  scores.  Overall,  the  officers  felt  that  their  decision-making  skills  had 
improved  as  a  result  of  the  training  they  received  and  that  decision-making  skills  could  be 
effectively  taught  using  virtual  environment  technologies.  Virtual  decision-skills  training  was 
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viewed  as  particularly  effective  for  the  inexperienced  lieutenant  during  the  “walk”  phase  of 
training. 

Utilization  of  Findings: 

The  research  showed  that  real  world  decision-making  skills  could  be  trained  using  virtual 
environment  technologies.  To  insure  maximum  benefit,  virtual  training  must  be  combined  with 
the  appropriate  field  experience  and  mentoring.  The  virtual  environment  can  also  serve  as  an 
effective  test  bed  (medium)  for  conducting  both  basic  and  applied  research  in  decision-making 
and  SA.  Conducting  research  in  a  controlled  virtual  environment  setting  permitted  closer 
empirical  scrutiny  of  the  linkage  between  decision-making  and  SA  in  dismounted  infantry 
operations  and  suggested  new  directions  for  further  work  in  these  areas. 
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Introduction 

Preparing  small  unit  leaders  (platoon,  squad,  and  team)  for  future  warfare  will 
present  many  challenges  to  trainers.  Leaders  must  be  capable  of  taking  effective 
independent  actions  across  an  increasingly  diverse  range  of  military  missions  including 
humanitarian  assistance,  peacekeeping,  peace  enforcement,  and  low  or  high  intensity 
conflict  as  part  of  a  joint,  combined,  or  interagency  operation  (TRADOC  PAM  525-66, 
2001).  The  small  unit  leader  must  be  prepared  to  deal  with  a  complex  battlefield  that 
could  change  in  scope  and  lethality  without  warning. 

Many  of  these  missions  will  likely  take  place  in  urban  settings.  Conducting  the 
requisite  training  at  existing  real-world  urban  training  sites  can  be  very  expensive  and 
inefficient  in  terms  of  the  specific  leader  skills  needed  for  such  operations.  The  small 
unit  leader  operating  in  an  urban  environment  has  a  cognitively  challenging  job.  He  must 
make  quick  decisions  in  a  complex,  uncertain,  and  very  fluid  environment. 

Conducting  missions  in  urbanized  terrain  puts  enormous  demands  on  a  leader’s 
situation  awareness  (SA).  The  complexities  of  the  urban  environment  including  the  three 
dimensional,  non-linear  aspects  of  the  urban  area,  a  poorly  defined  enemy,  an 
unpredictable  and  volatile  civilian  presence,  and  restrictive  rules  of  engagement  make  it 
difficult  to  sustain  high  levels  of  SA.  Such  environments  require  that  the  small  unit 
leader  attend  to  multiple  data  sources,  prioritize  among  competing  and  sometimes 
conflicting  goals,  and  make  rapid  decisions,  all  under  highly  stressful  conditions  (Strater, 
Endsley,  Pleban,  &  Matthews,  2001). 

Critical  to  the  unit’s  success  is  the  leader’s  ability  to  recognize  environmental 
cues  and  relevant  situational  factors,  maintain  situation  awareness,  apply  appropriate 
strategies,  and  make  effective  real-time  decisions.  Adequate  preparation  for  such 
missions  would  require  exposing  the  small  unit  leader  to  multiple  scenarios,  providing 
sufficient  practice,  and  timely  feedback  so  he  can  effectively  assimilate  the  many  lessons 
learned  from  the  training. 

Clearly,  following  such  an  approach  in  a  real-world  urban  training  site  would  be 
very  costly.  One  solution  is  to  conduct  a  portion  of  this  training  in  virtual  environments 
(VE)  through  the  use  of  individual  combatant  simulators. 

At  the  Dismounted  Battlespace  Battle  Lab  (DBBL)  Land  Warrior  Test  Bed 
(LWTB)  at  Fort  Benning,  Georgia,  for  example,  the  individual  soldier  or  small  unit 
leader  can  explore  iimovative  approaches  for  conducting  urban  operations  and  mission 
rehearsal  activities  in  virtual  settings.  Through  the  use  of  individual  combatant 
simulators,  soldiers  can  immerse  themselves  in  virtual  representations  (data  bases)  of 
urban  training  sites  such  as  the  McKeima  site  at  Fort  Benning,  and  conduct  limited 
missions  (e.g.,  clear  a  building,  conduct  area  reconnaissance).  Virtual  environments,  in 
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theory,  offer  soldiers  the  opportunity  to  thoroughly  rehearse  missions  to  familiarize 
themselves  with  the  procedural  aspects  of  specific  tasks  as  well  as  offering  a  chance  to 
examine  new  tactics  and  techniques.  These  simulators  allow  the  soldiers  to  play  out 
scenarios  and  determine  the  impact  of  various  courses  of  action  on  the  likely  success  of  a 
mission  (Pleban,  Eakin,  &  Salter,  2000). 

One  of  the  best  performing  of  the  currently  existing  individual  combatant 
simulation  systems  is  a  prototype  version  of  the  Soldier  Visualization  Station  (see  Salter, 
Eakin,  and  Knerr,  1999)  developed  by  Reality  by  Design  (RED).  This  system  represents 
the  currently  most  viable  overall  technical  approach  for  enabling  soldiers  to  shoot,  move, 
and  commxmicate  in  virtual  environments.  In  this  system,  the  soldier  stands  in  front  of  a 
large  screen  holding  a  rifle.  The  images  depicted  on  the  screen,  including  buildings, 
vehicles,  and  people  are  reasonably  life-like  in  size  and  actions.  The  combination  of 
images  and  action  creates  a  very  immersive  (virtual)  environment  for  the  soldier. 

The  S VS  is  a  PC  (Pentium)  based  system  with  an  ineitial/acoustic  tracker  for 
simulated  body  position  and  weapon  pointing.  It  includes  an  integrated  head  assembly 
subsystem  (helmet  mounted  display  -  HMD)  that  can  be  used  to  assist  in  aiming  and 
looking  around  comers  of  buildings.  The  SVS  has  one  flat  screen  on  which  images  are 
presented  by  a  rear  projection  device.  Movement  is  accomplished  by  applying  pressure 
to  a  weapon-mounted  thumbstick.  This  allows  the  individual  to  move  rather  effortlessly 
throughout  the  virtual  battlefield  to  include  open  terrain  and  urban  environments. 

Science  and  Technology  Objective  (STO)  Virtual  Environment  Research 

The  U.  S.  Army  Research  Institute  (ARI)  recently  established  a  four  year  Science 
and  Technology  Objective  (STO)  entitled  Virtual  Environments  for  Dismounted  Soldier 
Simulation  Training  and  Mission  Rehearsal  (1998).  The  purpose  of  the  STO  is  to 
examine  selected  technological  and  training  issues  that  currently  limit  high  fidelity 
dismounted  simulation  (see  Pleban,  Eakin,  and  Salter,  2000,  for  a  complete  listing  of 
STO  issues). 

A  collaborative  STO  effort  was  established  between  the  Infantry  Forces  and 
Simulation  Systems  Research  Units  of  ARI,  the  U.S.  Army  Simulation,  Training,  and 
Instrumentation  Command,  and  the  Human  Research  and  Engineering  and  Information 
Sciences  and  Technology  Directorates  of  the  U.S.  Army  Research  Laboratory  to  address 
theses  issues.  The  ARI  portion  of  the  STO  is  covered  under  the  work  package  Virtual 
Environment  Research  for  Infantry  Training  and  Simulation  (VERITAS).  Key 
VERITAS  work  objectives  include  the  following: 

•  Identify  potential  high-payoff  tasks  for  small  unit  leader  VE  training 

•  Evaluate  small  unit  training  vignettes  for  use  in  infantry  MOUT  training 

•  Develop  training  strategies  and  performance  measures 

•  Evaluate  the  training  effectiveness  of  simulation  systems 
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VERITAS:  FY  99  Research 


Pleban  et  al.  (2000)  addressed  the  first  two  objectives  {Identify potential  high- 
payoff  tasks  and  Evaluate  small  unit  training  vignettes)  in  separate  investigations.  Pleban 
et  al.  developed  five  small  unit  dismounted  infantry  scenarios  based  on  the  tasks  Assault, 
Move  Tactically,  Enter  Building/Clear  a  Room,  Reconnoiter  Area,  and  React  to  Contact. 
Fire  team  and  squad  level  missions  were  conducted  in  a  virtual  urban  environment  setting 
modeled  after  the  McKenna  training  area.  A  similar  set  of  scenarios  was  run  at  the  actual 
McKenna  training  site.  Overall,  the  simulators  were  seen  as  effective  for  small  unit 
training.  Although  the  data  were  based  on  subjective  reports,  the  soldiers  indicated  that 
the  simulations  had  improved  their  real-world  performance  on  similar  tasks  conducted  at 
the  McKenna  training  site. 

While  the  results  were  promising,  the  focus  in  this  study  was  very  basic,  i.e., 
could  soldiers  perform  key  dismounted  infantry  tasks  in  a  virtual  environment?  The 
results  indicated  that,  for  the  most  part,  they  could.  Soldiers  also  listed  a  number  of  ways 
these  simulators  could  be  effectively  used  for  small  unit  training.  Potential  training 
applications  include: 

•  Training  small  team  coordination/communication  skills 

•  Mission  rehearsal 

•  Developing  and  assessing  alternative  courses  of  action 

•  Developing  and  refining  small  unit  leader  decision-making  skills 

VERITAS:  FY  00  Research 


Year  two  leveraged  the  findings  from  the  previous  research  to  address  the  last  two 
VERITAS  objectives  {Develop  training  strategies  and  performance  measures  and 
Evaluate  training  effectiveness  of  simulation  systems).  The  overall  focus  of  this  research 
effort  was  to  investigate  the  potential  of  the  S  VS  as  a  decision  skills  trainer.  The  earlier 
research  by  Pleban  et  al.  (2000)  showed  that  the  SVS  system  could  be  used  to  train 
certain  aspects  of  room  clearing,  for  example.  However,  to  use  the  system  as  a  decision 
skills  trainer  would  require  more  complex  scenarios  and  an  effective  performance 
assessment/feedback  system.  More  importantly,  a  training  strategy  is  needed  that 
effectively  integrates  and  reinforces  the  skills  required  for  making  quick,  accurate 
decisions  under  high  stress  conditions. 

A  Situational-Based  Model  of  Decision-Making 

Research  presented  by  Klein  (1997)  indicated  that  in  naturalistic  settings 
characterized  by  uncertain  dynamic  environments,  shifting  or  competing  objectives,  time 
constraints,  and  high  stakes,  greater  training  value  can  be  obtained  by  helping  people  to 
quickly  size  up  situations  confronting  them  by  improving  their  proficiency  in  recognizing 
cues  and  patterns.  Earlier  observations  by  Klein  (as  cited  in  Drillings  and  Serfaty,  1997) 
revealed  that  decision-makers  in  difficult  situations  and  under  time  pressure  did  not 
appear  to  use  the  classical  approach  to  decision  making  (generate  options  and  directly 


compare  the  alternatives  to  make  decisions),  even  when  they  were  trained  in  that 
approach.  Klein’s  observations  led  him  to  hypothesize  that  decision-making  in  real 
world  environments  revolves  around  trying  to  understand  the  situation  and  judging  its 
familiarity  (to  other  situations). 

Naturalistic  versus  classical  approaches  to  decision-making.  The  naturalistic 
approach  to  decision-making  stands  in  direct  contrast  to  classical,  context-free  rational 
choice  strategies.  Under  the  classical  approach,  a  range  of  options  are  generated, 
evaluation  criteria  are  identified,  each  option  for  each  criterion  is  evaluated,  results  are 
calculated  and  the  option  with  the  highest  score  is  selected.  The  classical  approaches  to 
decision-making  focus  on  application.  They  try  to  improve  process  regardless  of  content 
area.  While  useful  in  some  situations  where  time  pressure  is  low  and  the  problem  is 
stable,  the  context-free  strategies  do  not  provide  an  optimal  means  for  improving 
decision-making  skills  in  naturalistic  real-world  environments  [see  Means,  Salas, 
Crandall  and  Jacobs  (as  cited  in  Klein,  1997)].  Klein  (1997)  argues  that  this  approach 
may  be  ineffective  because  it  tries  to  accommodate  all  situations,  but  does  not  fit  any 
specific  situation  very  well. 

To  be  successful  in  the  complex  battlefield  of  the  future,  the  small  unit  leader 
must  become  more  proficient  in  making  rapid,  accurate  assessments  of  the  decision 
situation  and  he  must  be  able  to  make  these  decisions  under  varying  levels  of  uncertainty 
and  severe  time  constraints.  This  will  place  a  premium  on  the  leader’s  ability  to 
simultaneously  read  and  assess  the  significance  of  various  situational  and  tactical  cues 
and  to  efficiently  manage  the  timing  of  decisions/mission  events  (Cannon-Bowers  & 

Bell,  1997;  Klein,  1997). 

The  Role  of  Situation  Awareness  (SA)  in  Naturalistic  Decision-Making 

Additional  research  [Drefus;  Klein;  Klein,  Calderwood,  &  Clinton-Cirocco  (as 
cited  in  Endsley,  1997)]  supports  Klein’s  earliest  observations.  Specifically,  under 
realistic  conditions,  experts  make  decisions  utilizing  a  holistic  process  involving  situation 
recognition  and  pattern  matching  to  mental  schemas  of  the  situation  to  make  rapid 
decisions.  Within  this  model,  a  person’s  situation  awareness,  an  internal 
conceptualization  of  the  present  situation,  becomes  the  driving  factor  in  the  decision¬ 
making  process  (Endsley,  1997). 

Situation  awareness  refers  to  the  cognitive  processes  involved  in  perceiving  and 
comprehending  the  meaning  of  a  given  stimulus  environment,  that  leads  to  soimd,  timely 
decisions  regarding  likely  future  events  in  that  environment  (Endsley,  1997).  Situation 
awareness  is  a  process  that  involves;  1)  the  perception  of  the  elements  in  a  particular 
environment;  2)  understanding  the  meaning  of  those  elements  and;  3)  the  ability  to 
translate  perception  and  understanding  of  the  environment  into  a  projection  of  future 
events  likely  to  occur  in  that  environment.  The  concept  of  S  A  has  been  rigorously 
applied  in  the  field  of  aviation  and  other  technologically  advanced  systems  where  the 
individual  must  perceive  and  comprehend  large  amounts  of  information  in  short  periods 
of  time  and  make  important  decisions  based  on  those  processes.  Breakdowns  in  the  SA 
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process  have  been  related  to  various  aviation  and  other  accidents  (e.g.,  Hartel,  Smith,  & 
Prince,  1991). 

According  to  Endsley  (1997),  many  human  errors  that  are  attributed  to  poor 
decision-making  usually  involve  problems  with  the  SA  portion  of  the  decision-making 
process.  People  make  the  correct  decision  based  on  their  perception  of  the  situation,  but 
that  perception  is  in  error.  In  realistic  settings,  the  major  task  facing  the  decision-maker 
is  establishing  an  ongoing  awareness  and  understanding  of  the  key  situational 
components.  Situation  awareness  provides  the  primary  input  to  the  decision  process  and 
plays  a  significant  role  in  shaping  the  decision  strategy  selected. 

The  Problem  of  Measuring  SA  in  Dismounted  Infantry  Environments 

Despite  the  key  role  of  SA  in  naturalistic  decision-making  and  infantry 
operations,  relatively  little  formal  consideration  has  been  given  to  its  role  in  battlefield 
success.  Several  factors  have  limited  the  application  of  SA  in  infantry  training/ 
operations.  First,  a  valid  set  of  metrics  tailored  to  assess  SA  in  dismounted  infantry 
operations  has  not  yet  been  developed.  Second,  until  recently,  there  has  been  no 
satisfactory  setting  where  core  SA  measurement  methodologies  such  as  the  Situation 
Awareness  Global  Assessment  Technique-SAGAT  (Endsley,  1988;  1995)  could  be 
administered  to  assess  dismounted  infantry  SA. 

The  SAGAT  procedure  involves  stopping  exercises  or  simulations  at  random 
points  and  asking  probe  questions  aimed  at  evaluating  a  participant’s  SA.  The  probe 
questions  focus  on  all  three  levels  of  SA  described  earlier  -  perception,  understanding, 
and  projection  of  future  events.  The  participant’s  SAGAT  responses  are  then  compared 
to  some  source  of  “ground  truth”.  This  requires  another  observer  to  verify  what 
constitutes  “correct”  answers  to  the  SAGAT  probes.  The  end  result  of  this  comparison 
process  is  an  objective  indication  of  the  participant’s  level  of  SA. 

Using  Virtual  Environments  for  Decision-Making/SA  Research  and  Training 

Research.  The  availability  of  the  LWTB  provides  an  ideal  setting  for  both  the 
administration  of  the  SAGAT  and  the  development  of  S  A  measurement  instruments  that 
can  be  used  by  trainers  and  researchers.  The  virtual  environment  setting  allows  for 
greater  control  of  both  extraneous  and  experimental  variables  than  would  be  possible  in  a 
real  world  training  site.  Using  the  SAGAT  process  in  a  controlled  setting  such  as  the 
LWTB  can  provide  the  objective  baseline  data  needed  to  validate  new  SA  measurement 
instruments.  This  type  of  setting  provides,  for  the  first  time,  a  unique  opportunity  to 
conduct  basic  and  applied  research  linking  SA  to  decision-making  in  simulated 
dismounted  infantry  environments. 

Training.  Simulations  can  play  a  key  role  in  training  naturalistic  decision-making 
skills  [Means,  Salas,  Crandall,  &  Jacobs  (as  cited  in  Cannon-Bowers  and  Bell,  1997)]  and 
possibly  refining  individual  SA  capabilities  as  well.  Simulations  can  accelerate 
proficiency  by  exposing  the  small  unit  leader  to  the  kinds  of  situations  he  is  likely  to 
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confront  in  the  real  world.  More  importantly,  a  simulation  can  be  controlled.  The 
characteristics  of  the  decision  problem  portrayed  in  a  mission  scenario  can  be  shaped  to 
address  specific  teaching  points  based  on  trainer  input.  Specific  situational  cues  and  cue 
patterns  from  various  sources  (e.g.,  audio  communications  from  squad  leaders  and  the 
company  commander,  terrain  and  building  characteristics,  presence  of  civilians,  enemy, 
aircraft,  heavy  weapons)  can  be  incorporated  in  the  scenarios.  In  addition,  time 
constraints  can  be  played  in  the  scenarios,  forcing  the  small  unit  leader  to  make  quick 
situational  assessments  and  decisions  under  stress. 

To  maximize  the  training  value  of  the  scenarios,  timely  (and  relevant)  feedback 
must  be  provided.  Research  reported  by  Cannon-Bowers  and  Bell  (1997)  indicated  that 
allowing  trainees  to  practice  on  a  task  without  feedback  may  produce  suboptimal 
decision-making  performance.  In  the  present  context,  feedback  means  reinforcing  the 
important  cue-action/strategy  associations  identified  in  the  scenarios.  This  feedback  is 
critical  for  helping  the  leader  characterize  cue  patterns  and  build  templates  (mental 
models)  that  will  enable  him  to  make  the  correct  associations  between  cues  or  cue 
patterns  and  appropriate  actions. 

Increasing  exposure  to  varied  scenarios,  combined  with  the  structured  feedback 
described  above,  should  enhance  the  leader’s  ability  to  accurately  characterize  situations 
and  lead  to  greater  situational  understanding.  This,  in  turn,  should  lead  to  improved 
decision-making  capability. 

Specific  Research  Objectives. 

The  close  linkage  between  Klein’s  (1997)  naturalistic  decision-making  model 
and  situation  awareness  concepts  (Endsley,  1 997)  suggested  the  two  areas  could  be 
addressed  under  a  single  comprehensive  research  effort  having  both  basic  and  applied 
objectives.  The  primary  objectives  of  the  present  research  were; 

1)  Determine  the  effectiveness  of  using  a  virtual  environment  (LWTB)  to  train 
real  world  decision-making  skills. 

2)  Determine  the  feasibility  of  using  a  virtual  environment  as  a  test  bed  for 
developing  SA  measurement  instruments. 

3)  Empirically  assess  the  role  of  SA  in  decision-making  in  simulated  dismoimted 
infantry  environments. 
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Method 


Overview 


Experienced  and  inexperienced  officers  were  put  in  an  immersive  virtual 
environment  and  given  four  scenarios  (missions)  to  execute.  Scenarios  included  built-in 
decision  points  that  required  the  officer  to  take  specific  actions  at  each  point.  The 
objectives  were  to  determine:  1)  if  decision-making  improved  over  repeated  trials  and  2) 
the  role  of  experience  in  facilitating  the  rate  of  learning. 

The  experiment  included  both  within  factor  (trials)  and  between  factor 
(experience)  variables.  The  experimental  design  required  one  subject  per  day,  alternating 
lieutenants  and  captains.  The  subject,  role-playing  a  dismounted  infantry  platoon  leader, 
conducted  four  virtual  urban  operation  missions.  Missions  for  trials  one  and  four 
switched  each  day.  Missions  for  trials  two  and  three  remained  the  same  throughout  the 
experiment.  Three  retired  military  officers/non-commissioned  officers  played  the  roles 
of  the  platoon  sergeant  and  the  squad  leaders.  An  infantry  major  role-played  the 
company  commander.  Another  infantry  major  served  as  an  observer.  A  retired  infantry 
officer  served  as  the  observer/controller  (0/C).  The  0/C’s  role  was  to  observe  the 
subject,  offer  guidance  during  the  scenario  (as  needed),  provide  immediate  feedback 
following  the  completion  of  each  scenario,  and  make  assessments  related  to  the  subject’s 
leader/decision-making  capability  and  level  of  situation  awareness.  An  ARI  researcher 
served  as  an  observer  and  data  collector. 

The  sequencing  and  administration  of  the  data  collection  instruments  during  the 
experiment  is  summarized  in  Table  1 .  For  example,  each  subject  completed  four 
instruments  -  Biographical  Information  Questionnaire,  SAG  AT  in  trials  2  and  3,  self- 
ratings  of  SA  after  each  trial,  and  the  Post-Experiment  Questionnaire.  The  squad  leaders 
completed  the  Execution  Scale  after  each  trial.  The  actual  instruments  are  described 
later. 

Subjects 

Subjects  were  14  male  officers  from  Fort  Benning,  Georgia.  One  of  the  officers 
was  Armor;  the  other  13  were  Infantry.  The  average  age  of  the  seven  lieutenants  was  23 
years,  8  months.  For  the  captains,  the  average  age  was  27  years,  10  months.  Time  in 
service  ranged  from  11-83  months  for  the  lieutenants  and  from  49-133  months  for  the 
captains.  All  officers  were  Airborne  qualified  and  four  of  the  seven  officers  from  each 
group  had  successfully  completed  Ranger  school. 

Six  of  the  lieutenants  and  three  of  the  captains  had  trained  at  the  McKenna 
MOUT  (Military  Operations  on  Urban  Terrain)  site  at  Fort  Benning  from  one  to  three 
times  since  basic  training.  Only  one  officer  had  ever  operated  a  virtual  individual 
combatant  simulator  such  as  the  type  employed  at  the  LWTB.  However,  almost  all  had 
some  experience  with  military  simulation  systems  such  as  JANUS,  Simulation 
Networking  (SIMNET),  and  the  Close  Combat  Tactical  Trainer. 
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Table  1 


Data  Collection  Instruments  Used  in  the  Experiment 


Instrument 

Test 

Subject 

Observer 

Controller 

Company 

Commander 

Squad 

Leaders 

ARI 

Observer 

Biographical 
Information  Q 

Training 

Adequacy  of  the 

Plan  Scale 

Trials 

1,2,3, 4 

Appropriate  Level 
of  Initiative  Scale 

Trials 

1,2, 3,4 

Plan’s  Fit  w/  Cdr’s 
Intent  Scale 

Trials 

1, 2,3,4 

Leader’s  Rationale 
Scale 

Trials 

1,2, 3, 4 

Mission 

Performance  Scale 

Trials 

1,2,3, 4 

Execution  Scale 

Trials 

1,2,3,4 

SABARS 

SAGAT 

PSAQ 

Trials 

1,2A4 

Post-Exp.  Q 

Debrief 

Object.  Decision- 
point  Responses 

Trials 

1^3,4 

Note.  SABARS  -  Situation  Awareness  Behaviorally  Anchored  Rating  Scale; 
SAGAT  -  Situation  Awareness  Global  Assessment  Technique; 

PSAQ  -  Post-Trial  Participant  Subjective  SA  Questionnaire. 


Instruments 


Biographical  Information  Questioimaire.  The  Biographical  Information 
Questionnaire  (Appendix  A)  is  a  multiple  choice/short  answer  paper-and-pencil 
instrument  designed  to  document  the  prior  military  training  and  experience  of  each 
subject,  as  well  as  their  experience  with  computers  and  simulations. 

Observer/Controller  (0/C)  Decision-Making/Leadership  Rating  Instruments.  As 
part  of  the  experiment,  each  subject  was  required  to  develop  a  plan.  The  Adequacy  of  the 
Plan  (Adequacy)  Scale  (Appendix  B)  consists  of  10  yes-no  items  that  address  various 
aspects  of  the  subject’s  (platoon  leader’s)  plan.  Areas  included,  for  example,  level  of 
detail,  feasibility  of  approach,  and  ease  of  understanding.  One  global  assessment  item 
was  included.  It  used  a  five-point  scale  with  anchor  points  “Very  Good”,  “Good”, 
“Borderline”,  “Poor”,  and  “Very  Poor”.  (All  global  assessment  items  for  the  scales 
described  below  used  the  same  five-point  scale.)  The  Adequacy  Scale  was  completed  by 
the  0/C  after  the  subject  had  briefed  his  plan  to  the  squad  leaders. 
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The  Appropriate  Level  of  Initiative  (Initiative)  Scale  (Appendix  C)  consists  of 
eight  yes-no  questions  designed  to  assess  the  level  of  initiative  demonstrated  by  the 
subject  during  the  scenario.  Items  addressed  the  timeliness  of  decisions,  appropriateness 
of  actions  for  the  situation,  ability  to  improvise  within  the  commander’s  intent,  and  the 
ability  to  work  effectively  in  fluid  environments.  The  0/C  also  provided  a  global 
assessment  of  initiative. 

The  Plan ’s  Fit  within  Commander ’s  Intent  (Intent)  Scale  (Appendix  D)  was 
formatted  similarly  to  the  previous  two  instruments.  This  scale  consists  of  three  yes-no 
items  and  one  global  assessment  rating.  The  scale  was  designed  to  assess  the  subject’s 
ability  to  tailor  his  plan  within  a  larger  unit  plan.  Areas  addressed  included  actions  based 
on  the  intent  of  higher  command  and  consideration  of  other  friendly  units.  Both  the 
Initiative  and  Intent  Scales  were  completed  by  the  0/C  at  the  conclusion  of  each 
exercise/scenario. 

Company  Commander  Decision-Making/Leadership  Rating  Instruments.  The 
infantry  major  role-playing  the  company  commander  completed  two  instruments 
following  the  completion  of  each  scenario.  The  Leader ’s  Rationale  Scale  (Appendix  E) 
is  composed  of  four  yes-no  questions  and  one  global  assessment  rating.  The  scale  was 
designed  to  assess  the  soundness  of  the  subject’s  actions  taken  during  the  scenario  (e.g., 
decisions  were  based  on  a  reasonable  assessment  of  the  enemy;  decisions  demonstrated 
an  understanding  of  the  strengths  and  weaknesses  of  the  situation).  The  Mission 
Performance  Scale  (Appendix  F)  was  the  company  commander’s  assessment  of  the 
mission  (e.g.,  was  the  mission  accomplished?;  was  the  mission  accomplished  in  a  timely 
fashion?).  The  scale  consists  of  four  yes-no  items  and  one  global  assessment. 

Squad  Leaders’  Decision-Making/Leadership  Rating  Instrument.  The  squad 
leaders  filled  out  the  Execution  Scale  (Appendix  G)  following  the  completion  of  each 
exercise  scenario.  The  scale  consisted  of  three  yes-no  items  and  one  global  assessment 
item.  The  focus  of  this  scale  was  on  the  clarity  of  orders  received  from  the  test  subject, 
and  whether  the  orders  adequately  communicated  unit  objectives. 

Situation  Awareness  Behaviorally  Anchored  Rating  Scale  (SABARS). 

Following  the  completion  of  each  scenario,  the  0/C  completed  a  SABARS  rating  form 
(Appendix  H)  for  each  subject.  The  SABARS  (Matthews,  Pleban,  Endsley,  &  Strater, 
2001)  consists  of  28  items  designed  to  assess  how  (well)  the  subject  acquires  and 
disseminates  information  during  the  course  of  the  scenario  (from  the  0/C’s  perspectiye). 
The  subject’s  SA  was  reflected  in  such  items  as  “Uses  assets  to  effectively  assess 
environment”;  “Communicates  key  information  to  commanding  officer”;  “Employs 
squads  tactically  to  gather  needed  information”;  and  “Communicates  to  squads  overall 
situation  and  commander’s  intent”.  Behaviors  were  rated  on  a  five-point  scale  as  “Very 
Poor”,  “Poor”,  “Borderline”,  “Good”,  or  “Very  Good”.  An  additional  response  for  “Not 
Applicable”  was  added  for  items  (actions)  that  could  not  be  assessed  from  the  scenario. 

Situation  Awareness  Global  Assessment  Technique  (SAGAT).  SAGAT  items 
consisted  of  21  questions  relevant  to  infantry  MOUT  operations  and  aimed  at  assessing 
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the  subject’s  level  of  SA  at  specific  times  over  the  course  of  the  scenario.  Questions 
focused  on  areas  such  as  the  location  of  friendly  and  enemy  elements,  strongest  and 
weakest  friendly  locations,  and  projections  of  enemy  and  civilian  actions.  The  SAGAT 
was  presented  to  the  subject  on  a  lap  top  computer.  The  company  commander  completed 
a  paper-and-pencil  version  of  the  same  instrument.  The  company  commander’s 
responses  provided  the  baseline  “ground  truth”  from  which  the  subject’s  responses  were 
compared.  The  resulting  comparison  provides  an  indication  of  the  subject’s  objective 
level  of  S A  (Appendix  I) 

Post-Trial  Participant  Subjective  SA  Questionnaire  (PSAQ).  The  PSAQ 
(Appendix  J)  is  a  three-item  instrument  designed  to  assess  not  only  each  subject’s 
perceived  level  of  SA  during  the  scenario,  but  also  work-load  (How  hard  were  you 
working  during  the  scenario?)  and  quality  of  performance  (How  well  did  you  perform 
during  the  scenario?).  The  PSAQ  was  administered  at  the  conclusion  of  a  scenario  and 
each  item  was  rated  on  a  five-point  scale.  The  SA  item  asks  the  subject  to  indicate  how 
aware  he  was  of  the  evolving  situation  during  the  scenario.  Response  categories  range 
from  “Not  Aware  of  the  Situation”  to  “Completely  Aware  of  the  Situation”. 

Post  Experiment  Questionnaire.  The  Post  Experiment  Questionnaire 
(Appendix  K)  was  administered  to  each  subject  following  the  completion  of  all  scenarios. 
The  questionnaire  is  a  multiple  choice/short  answer  instrument  developed  to  obtain 
specific  information  concerning: 

•  The  training  value  of  the  scenarios 

•  The  challenge/difficulty  level  of  the  scenarios 

•  What  soldiers  liked  most/least  about  the  training 

•  Suggestions  for  making  the  training  more  effective 

•  Whether  the  current  training  improved  decision-making  skills 

•  The  feasibility  of  training  decision-making  skills  in  virtual  environments 

•  The  value  of  including  virtual  environment  decision-making  skills  training  in  the 
Infantry  Officer  Basic  Course  curriculum 

Responses  to  selected  items  were  discussed  in  more  detail  during  follow-up  interviews 
with  one  of  the  ARI  researchers. 

Small  Unit  Leader  Decision-Making  Scenarios 


All  scenarios  were  set  as  if  in  a  small  European  town.  The  town  was  a  virtual 
representation  of  the  McKenna  MOUT  training  site.  Military  subject  matter  experts 
developed  four  scenarios  that  included:  Stability  and  Security  Operations  (SASO), 
Company  Assault,  Defend,  and  Secure  Village.  Each  scenario  had  from  four  to  seven 
predetermined  decision  points.  For  each  decision  point,  several  leader  actions  were 
identified  (e.g.,  discuss  rules  of  engagement  with  squad  leaders,  send  experienced  squad 
to  conduct  patrol,  report  to  company  commander,  send  fragmentary  order,  determine 
injury  status  of  soldiers/civilians).  Appendixes  L-0  provide  specific  flow  charts  detailing 
the  decision  process  for  these  scenarios. 


Scenarios  were  designed  to  be  cognitively  challenging  for  the  subjects.  This  was 
accomplished  by  imposing  1)  severe  time  constraints,  2)  high  levels  of  uncertainty,  and 
3)  multiple/rapid  decision  requirements.  Specific  teaching  points  were  addressed  in  each 
scenario.  Scenarios  incorporated  a  number  of  events  (e.g.,  presence  of  snipers,  unruly 
civilian  crowds,  friendly  and  civilian  fratricide,  exposure  to  chemical  agents,  and  weapon 
misfires  to  further  complicate  the  scenario.  These  distracters  were  included  to  force  each 
subject  to  prioritize  events  and  stay  focused  on  the  larger  mission  at  hand.  The  scenarios 
minimized  the  amount  of  platoon  leader  movement  required.  This  was  done  to  keep  the 
run-times  of  scenarios  to  approximately  20-25  minutes  and  to  maintain  each  subject’s 
focus  on  the  cognitive  aspects  of  the  mission. 

The  scenarios  focused  primarily  around  the  interaction  between  the  subject 
(platoon  leader),  his  three  squad  leaders,  the  company  commander  and  the  platoon 
sergeant.  Computer-generated  avatars.  Dismounted  Infantry  Semi-Automated  Forces 
(DI-SAF)  were  employed  to  fill  the  individual  squad  member  positions  for  each  squad. 

In  general,  DI-SAF  soldiers  were  used  very  sparingly  in  the  scenarios.  (One  role  player 
played  the  parts  of  two  squad  leaders.) 

Apparatus 

Soldier  Visualization  Station  (SVS).  Three  full-immersion  SVS  systems  (helmet 
mounted  display  -  HMD,  weapon,  screen)  were  employed  along  with  a  desktop  version. 
The  desktop  system  was  joystick  controlled.  The  three  stand-alone  systems  were  linked 
to  the  desktop.  Technical  specifications  of  the  two  systems  are  shown  in  Table  2.  Squad 
leaders  could  communicate  with  each  other.  Each  subject  (platoon  leader)  could 
communicate  with  the  squad  leaders,  the  platoon  sergeant,  and  the  company  commander. 
Communication  nets  and  procedures  were  similar,  but  not  identical  to  what  subjects 
would  be  accustomed  to  in  a  real  world  environment.  The  three  SVS  systems  were 
housed  in  their  own  enclosures.  These  enclosures  were  made  of  thick  black  cloth  and 
fastened  to  a  metal  frame  surrounding  the  SVSs.  They  were  designed  to  dampen 
extraneous  sound,  reduce  light,  and  minimize  distractions  fi'om  other  people  moving 
around  the  area.  One  panel  of  cloth  on  the  subject’s  enclosure  was  tied  back  to  allow  the 
0/C  and  the  researcher  to  observe  and  record  activities  from  the  rear  perimeter  of  the 
SVS. 


Each  test  subject  and  squad  leader  operated  an  SVS,  while  the  company 
commander  operated  the  desktop  system.  The  platoon  sergeant  observed  events  from 
either  the  DI-SAF  operator’s  computer  screen  depicting  a  top-down  view  of  McKenna  or 
by  looking  at  the  company  commander’s  screen.  The  company  commander  and  DI-SAF 
operator  systems  were  adjacent  to  each  other,  but  away  from  the  SVS  systems. 
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Table  2 


Technical  Specifications  of  the  Immersive  SVS  and  Desktop  SVS  Simulation  Systems 


System  Hardware 
(Immersive  and 
Desktop) 

•  Pentium  III  -  450  MHz  microprocessor 

•  128  Mb  RAM 

•  Obsidian  200  -  8440  3D  Graphics  Card 

•  SoundBlaster  AWE  64  Gold  Audio  Card 

•  Removable  4.55  GB  SCSI  Hard  Drive 

Movement  Control 

•  Weapon-mounted  thumbswitch 

•  Desktop  SVS  -  Microsoft  joystick  control 

Motion  Capture/ 
Weapon  Tracking 

•  InterSense  Mark2  X-Bar  Tracking  System 

•  Weapon  tracking  accurate  to  within  14  of  1  ° 

Visual  Display 

•  90°  X  60°  FOV  at  center  of  enclosure  (varies  with  position  change) 

•  Rear  screen  projection  resolution  1 024  x  768 

•  Desktop  SVS  resolution  800  x  600 

Enclosures 

•  Aluminum  frame  over  black  sound-dampening  fabric.  (10  x  10  x 

12) 

Software 

•  Reality  By  Design  proprietary  software 

Automated  Performance  Assessment  System.  The  decision-point  actions  of  the 
subject  were  recorded  by  one  of  the  ARI  researchers  using  a  personal  computer.  A 
graphic  user  interface  (GUI)  board  was  created  for  each  scenario  that  listed  all  leader 
actions  (actually  non-actions)  by  decision  point.  For  example,  decision-point  3  of  the 
SASO  scenario  consisted  of  the  following  non-actions:  “No  SITREP  to  commander”, 
“Fails  to  obtain  status  of  WIA”,  and  “Fails  to  provide  instructions  (to  squads)”.  If  the 
subject  failed  to  engage  in  the  appropriate  action,  the  researcher,  using  a  mouse,  clicked 
on  the  specific  activity  listed  on  the  GUI  board.  The  entry  was  then  recorded  and  time- 
stamped. 

Procedure 


Role  player  training.  Training  took  place  prior  to  the  experiment  and  consisted  of 
two  parts.  The  first  part  lasted  approximately  three  days  and  involved  all  of  the  role 
players  and  the  GUI  board  operator.  Several  “dry  runs”  were  conducted  where  the  role 
players  (squad  leaders,  platoon  sergeant,  and  company  commander)  walked  through  the 
scenarios  and  familiarized  themselves  with  the  scripts  and  the  timing  of  the  verbal  cues 
that  they  would  provide  the  platoon  leader  to  trigger  his  decision  actions.  Role  players 
were  also  given  time  to  familiarize  themselves  with  the  simulation  systems.  After  the 
“dry  runs”  were  completed  a  full  rehearsal  was  conducted  on  the  last  day.  An  infimtry 
officer,  who  would  serve  as  an  extra  observer  during  the  experiment,  played  the  role  of 
platoon  leader.  All  four  scenarios  were  run  and  decision-point  data  were  collected.  After 
the  full  rehearsal  was  conducted,  any  modifications  that  were  needed  from  a  procedural 
standpoint  were  completed. 


12 


Soldier  training.  Each  subject  arrived  in  the  morning  at  the  Land  Warrior  Test 
Bed  and  was  briefed  on  the  objectives  of  the  experiment.  He  was  given  a  chance  to  ask 
any  questions  concerning  his  role  in  the  experiment.  He  then  completed  the  Biographical 
Information  Questionnaire. 

After  completing  the  questionnaire,  the  subject  was  familiarized  with  the  SAGAT 
procedures.  A  technician  was  present  to  explain  the  SAGAT  process  and  to  answer  any 
questions.  The  subject  was  then  allowed  to  work  through  a  SAGAT  test  run  that  was 
presented  on  a  lap  top  computer.  [SAGAT  items  were  based  on  an  extensive 
requirements  analysis  that  focused  on  the  execution  of  the  Assault  (Attack)  and  Defend 
(Secure  and  Hold)  missions  in  a  MOUT  environment.  A  determination  was  made  not  to 
use  these  missions  as  either  the  pre  or  post-tests  due  to  the  possible  performance  cueing 
effects  of  the  SAGAT  procedure  on  decision-making  scores.] 

Following  the  SAGAT  training,  the  subject  was  given  a  brief  introduction  to  the 
SVS  system  and  allowed  hands-on  time  to  familiarize  himself  with  some  of  the  key 
system  features  (e.g.,  moving  within  the  SVS  area,  moving  via  the  thumb  switch  on  the 
M-4  rifle,  engaging  targets).  In  addition,  he  was  shown  what  various  entities  looked  like 
in  the  virtual  world  (e.g.,  buildings,  furniture,  ffiendly/enemy  forces,  civilians,  vehicles, 
and  aircraft). 

Experimental  procedure.  Once  the  training  phase  was  completed,  the  subject  read 
written  personal  profiles  describing  the  company  commander,  platoon  sergeant,  and  the 
three  squad  leaders.  The  experimenter  told  the  subject  that  the  role  players  would  play 
the  personalities  of  the  individuals  depicted  in  the  profiles.  These  profiles  provided  cues 
that  would  affect  the  decisions  made  by  the  subject  (platoon  leader)  during  the  scenarios, 
e.g.,  which  squads  to  deploy. 

After  reading  the  profiles,  the  subject,  the  company  commander,  and  the  0/C  met 
in  the  LWTB  conference  room.  The  company  commander  briefed  the  mission  to  the 
subject  who  was  given  a  chance  to  ask  questions  and  then  allowed  10-15  minutes  to 
develop  his  plan.  The  subject  then  briefed  his  plan  to  the  squad  leaders  and  the  platoon 
sergeant.  The  0/C  completed  the  Adequacy  ?>cale  at  this  time. 

The  subject  and  squad  leaders  then  proceeded  to  the  simulator  bay  and  to  their 
assigned  immersible  SVS  systems.  The  company  commander  moved  to  the  desktop 
system  co-located  with  the  immersible  SVSs.  The  platoon  sergeant  stayed,  for  the  most 
part,  with  the  company  commander.  After  completing  system  checks  on  the  SVSs  and 
the  communication  nets,  the  scenario  started. 

For  each  scenario,  the  ARI  researcher  recorded  decision  point  responses  on  the 
PC  while  the  0/C  provided  limited  coaching  as  needed.  After  the  completion  of  the  first 
scenario  (pre-test),  the  0/C  provided  immediate  feedback  to  the  subject  on  key  actions 
that  he  missed  (e.g.,  failure  to  have  squad  immediately  mask  when  informed  of  chemical 
agent  leak,  failure  to  call  for  cease  fire  after  fratricide  incident)  or  incorrect  information 
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provided  to  the  squad  leaders  or  to  the  company  commander.  The  0/C  then  completed 
the  Initiative  and  Intent  Scales  along  with  the  SABARS.  The  subject  filled  out  the  PSAQ 
at  this  time.  Concurrently,  the  squad  leaders  completed  the  Execution  Scale,  and  the 
company  commander  completed  the  Leader ’s  Rationale  and  Mission  Performance 
Scales.  The  trial  concluded  with  an  After  Action  Review  (AAR)  that  was  led  by  the 
company  commander.  At  this  time  the  subject  summarized  the  mission  and  was  asked 
by  the  company  commander  to  elaborate  on  key  events  and  discuss  specific  lessons 
learned.  Additional  feedback  was  provided  by  the  role  players  and  the  0/C. 

Trials  two  and  three  were  identical  to  trial  one  (pre-test)  with  one  exception.  At 
selected  points  during  these  scenarios,  a  S AGAT  stop  was  announced  and  the  scenario 
halted  at  that  point.  At  this  time  the  SAGAT  technician  wheeled  a  cart  into  the  SVS. 

The  cart  held  the  lap  top  system  and  allowed  the  subject  to  remain  in  place.  The  platoon 
leader  was  given  four  minutes  to  complete  the  SAGAT  items  (results  from  the  earlier 
rehearsals  indicated  this  time  interval  was  sufficient  to  complete  all  items).  During  this 
same  time,  the  company  commander  completed  a  paper-and-pencil  version  of  the 
SAGAT.  There  were  three  SAGAT  halts  for  each  scenario  (Company  Assault  and 
Defend).  With  the  exception  of  rotating  scenarios,  trial  four  (post-test)  was  run 
identically  to  trial  one  (pre-test).  For  the  experienced  group,  the  first  trial  was  always 
Secure  Village  and  trial  four  was  SASO.  For  the  inexperienced  group,  the  order  was 
reversed  (i.e.,  SASO  for  trial  one  and  Secure  Village  for  trial  four).  Trials  two  (Assault) 
and  three  (Defend)  were  presented  in  the  same  order  for  both  groups. 

Results 

Analyses  were  guided  by  three  major  questions:  1)  Did  decision-making/SA 
improve  over  trials?;  2)  Did  level  of  experience  moderate  the  rate  of  learning  over 
trials?;  3)  What  was  the  relationship  between  decision-making  and  SA? 

Observer/Controller  (0/C)  Decision-MakinR/Leadership  Ratings 

Separate  mixed-factor  repeated  measures  analyses  of  variance  (ANOVA)  were 
computed  for  each  of  the  decision-making/leader  rating  scales  completed  by  the  0/C. 

This  included  the  Adequacy  (of  the  plan),  Initiative,  and  Intent  Scales.  ANOVAs  were 
performed  for  only  the  global  rating  items  of  each  scale.  The  alpha  required  for 
significance  in  all  analyses  was  set  at  p  <  .05. 

No  significant  group  (experience),  trial,  or  group-by-trial  interaction  effects  were 
obtained.  Overall,  the  experienced  group  received  higher  scores  than  the  inexperienced 
group  on  all  scales,  but  the  differences  were  slight.  The  majority  of  ratings  for  the 
experienced  group  were  in  the  “good”  range  (4.00  -  4.29).  Overall,  the  ratings  for  the 
inexperienced  group  fell  about  one-half  point  below  the  experienced  group  (3.57  -  3.86). 
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Company  Commander  Decision-Making/Leadership  Ratings 


Separate  analyses  for  the  Leader’s  Rationale  and  Mission  Performance  Scales 
(global  ratings)  revealed  no  significant  differences.  Both  the  experienced  and 
inexperienced  groups  tended  to  be  rated  equally  high  (3.7  -  4.1)  on  each  scale. 

Squad  Leaders’  Decision-Making  Leadership  Ratings 

Analyses  of  the  squad  leaders’  global  ratings  from  the  Execution  Scale  showed  a 
tendency  for  improved  clarity  of  communication  over  trials,  but  the  differences  were  not 
significant.  Ratings  indicated  that  platoon  leaders  became  clearer  in  their  instructions, 
(i.e.,  simple  and  sufficient  instructions,  clear  intent)  to  the  squad  leaders  over  time. 
Overall,  the  ratings  clustered  around  the  “borderline”  to  “good”  range. 

Objective  Assessment  of  Decision-Making  Skills 

Each  time  a  subject  failed  to  take  a  specific,  tactically  advisable  action  listed 
under  a  given  decision-point,  this  non-action  was  noted,  the  entry  time  stamped  and 
saved.  These  non-actions  (errors)  were  then  summed  and  a  percentage  was  calculated 
based  on  the  total  number  of  possible  non-actions  for  each  decision  point.  The  resulting 
metric  (percentage  of  incorrect  responses)  provided  a  measure  of  decision-making 
competency  over  trials. 

The  results  from  the  repeated  measures  ANOVA  revealed  a  significant  trial  effect, 
F(3,  36)  =  3.3,  p  <  .04.  Figure  1  depicts  a  non-linear  pattern  over  trials.  Decision¬ 
making  errors  (failure  to  act)  increased  from  trials  1  and  2,  and  then  decreased  over  the 
remaining  trials. 

Overall,  there  was  a  tendency  for  the  experienced  group  to  make  fewer  errors  over 
trials  than  the  inexperienced  group.  A  post-hoc  comparison  (Keppel,  1973,  p.  41 1)  was 
calculated  between  trials  one  and  four.  The  resulting  comparison  approached  statistical 
significance  (.05  <  p  <  .06).  Fewer  errors  were  made  in  trial  four  than  in  trial  one. 
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MEAN  %  ERRORS 


TRIAL  SEQUENCE 


Figure  1 .  Mean  percentage  of  decision-making  errors  over  trials  by  group. 


Each  decision  point  included  an  extra  category  to  cover  unexpected  or 
unforecasted  actions  made  by  each  subject.  These  responses  were  analyzed  separately 
from  the  other  responses.  Interestingly,  the  experienced  group  engaged  in  more 
unforecasted  actions  (47)  than  the  inexperienced  group  (25).  Group  differences  were 
most  pronounced  for  the  Secure  Village  and  Defend  scenarios. 


Subjective  Ratings  of  Situation  Awareness 


Mixed  factor  repeated  measures  ANOVAs  were  computed  for  the  two  subjective 
measures  of  SA,  the  Situation  Awareness  Behaviorally  Anchored  Rating  Scale 
(SABARS),  and  the  Post-Trial  Participant  Subjective  SA  Questionnaire  (PSAQ).  For  the 
SABARS,  individual  responses  (except  the  global  response  item)  were  combined  and  a 
mean  SA  score  was  computed  for  each  subject.  The  results  from  the  SABARS  analyses 
revealed  a  trend  for  SA  to  improve  over  trials,  based  on  the  0/C’s  subjective  assessment. 
The  experienced  group  also  tended  to  receive  higher  ratings  (2.73  -  3.0)  than  the 
inexperienced  group  (2.62  -  2.76)  over  trials.  Neither  the  group,  trial,  or  group-by-trial 
interaction  effects  reached  established  significance  levels,  p  >  .05. 

With  regard  to  the  PSAQ  ratings,  each  item  was  analyzed  separately.  Subjects’ 
perceived  levels  of  situation  awareness  did  not  significantly  improve  over  trials.  For  the 
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most  part,  both  groups’  self-ratings  were  on  the  high  side  (3.71  -  4.14)  indicating  a  fairly 
high  level  of  situation  awareness  across  trials. 

No  significant  differences  were  found  on  how  well  subjects  thought  they 
performed  during  the  trials  or  for  work  effort.  There  was  a  tendency,  however,  for  both 
groups  to  work  hardest  during  the  assault  scenario. 

Objective  Ratings  of  Situation  Awareness 

Items  from  the  Situation  Awareness  Global  Assessment  Technique  (SAG AT) 
were  analyzed  (ANOVA)  separately  since  previous  research  has  shown  that  SA  accuracy 
on  individual  items  is  dependent  on  different  aspects  of  the  situation.  For  this  reason,  a 
single  combined  SAGAT  score  was  not  used  in  the  analyses  (Slater,  Endsley,  Pleban,  & 
Matthews,  2001). 

The  most  noteworthy  findings  centered  around  experience  levels  and  items  asking 
the  subjects  to  identify  various  elements  on  a  map.  The  results  from  the  analyses  showed 
that  experienced  officers  were  significantly  better  at  locating  both  enemy  troops 
[F(l,  69)  =  4.81,  2  <  .04]  and  elements  of  their  own  platoon  [F(l,  69)  =  5.19,  p  <  .03]  on 
the  map.  The  results  also  showed  that  experienced  officers  were  better  at  identifying 
both  the  strongest  enemy  locations  [F(l,  59)  =  8.14,  p  <  .01]  and  the  location  of  the 
element  posing  the  highest  threat  to  their  platoon  [F(l,59)  =  6.48,  p  <  .02]  than 
inexperienced  officers.  Conversely,  inexperienced  officers  were  better  at  identifying  the 
locations  of  the  strongest  friendly  elements  than  experienced  officers,  F(l,59)  =  6.89, 

p  <  .02. 

Comparison  of  Situation  Awareness  Measures 


The  three  SA  measures  were  compared  through  a  series  of  step-wise  regression 
analyses  to  determine  whether  the  behaviors  rated  on  the  SABARS  and  the  self-ratings 
(PSAQ)  were  predictive  of  the  level  of  objective  SA  as  measured  by  the  SAGAT 
procedure.  Separate  analyses  were  performed  with  each  of  the  SAGAT  items  serving  as 
criterion  variables.  (Each  SAGAT  item  used  in  the  analyses  represented  a  mean  score 
based  on  the  subject’s  responses  to  the  item  over  the  six  halts.) 

To  enhance  the  interpretive  value  of  the  SABARS,  item  scores  were  subjected  to 
a  factor  analysis  (see  Strater,  Endsley,  Pleban,  and  Matthews,  2001).  The  resulting 
analysis  combined  the  20  items  completed  by  the  0/C  for  each  scenario  into  four  factors. 
These  factors  were  labeled  by  Strater  et  al.  (2001)  as:  Gathering  Information  and 
Following  Procedures  (e.g..  Uses  assets  to  effectively  assess  environment);  Focusing 
Inside  the  Platoon  versus  Outside  the  Platoon  (e.g.,  Commimicates  key  information  to 
commanding  officer);  Proactively  Seeking  Key  Information,  (e.g..  Employs  squads 
tactically  to  gather  needed  information);  and  Focusing  on  the  Big  Picture  (e.g.. 
Communicates  key  information  to  squad  leaders). 
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Results  showed  that  two  SABARS  factors  {Proactively  Seeking  Key  Information 
and  Focusing  on  the  Big  Picture)  and  two  PS AQ  measures  (self-rated  SA  and  workload) 
accounted  for  a  significant  (2  <  .05)  part  of  the  variance  (15.1  -  41.3  percent)  in  five 
SAGAT  items.  The  five  SAGAT  items  that  were  best  predicted  from  the  SABARS  and 
PSAQ  measures  included:  a)  percentage  of  enemy  locations  correctly  identified;  b) 
number  of  adjacent  friendly  units  correctly  identified;  c)  correct  identification  of 
strongest  enemy  opposing  force  locations;  d)  correct  identification  of  the  number  of 
casualties  suffered  and;  e)  degree  of  awareness  of  which  force  had  the  advantage.  A 
complete  description  and  discussion  of  the  three  SA  measures,  their  interrelationships, 
and  additional  experimental  findings  are  provided  by  Strater  et  al.  (2001).  Overall,  the 
results  showed  that  the  SABARS  and  PSAQ  were  not  strong  predictors  of  objective 
levels  of  SA. 

Predicting  Decision-Making  Accuracy  from  Situation  Awareness  Measures 

A  step-wise  regression  analysis  was  computed  using  the  decision-making 
accuracy  scores  of  the  subjects  and  their  responses  from  the  three  situation  awareness 
measures  collected  during  the  assault  and  defend  scenarios.  Scores  fi-om  1 3  SAGAT 
items,  the  four  SABARS  factors,  and  the  three  (PSAQ)  items  served  as  the  predictor 
variables.  The  platoon  leader  decision-making  accuracy  score  served  as  the  criterion. 

Five  of  the  SA  measures,  as  shown  in  Table  3,  predicted  69%  of  the  variance  in  decision¬ 
making  accuracy.  One  key  predictor  was  the  SABARS  factor  Focused  Inside  the  Platoon 
versus  Outside  the  Platoon.  This  factor  included  0/C  ratings  for  the  items 
“Commimicates  key  information  to  commanding  officer”;  “Gathers  follow  up 
information  when  needed”;  “Asks  for  pertinent  intelligence  information”;  “Assesses  key 
finds  and  unusual  events”  and;  “Discerns  key  information  from  reports  received”.  The 
participants’  self-rated  workload,  and  their  SAGAT  scores  indicating  the  degree  to  which 
they  were  aware  of  exposed  friendlies,  which  side  had  the  advantage,  and  which  elements 
were  not  in  communication  with  them  all  contributed  to  explaining  the  variance  in  the 
decision  score. 
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Table  3 


Summary  of  Stepwise  Regression  Analysis  for  Variables  Predicting 
Decision-Making  Accuracy  (N  =  27) 


Variable 

B 

SEE 

.  ^  r  "  ^ 

Stepl 

•  SABARS-Information  Gathering 

-.045 

.012 

Step  2 

':v  ^ 

•  SABARS-Information  Gathering 

-.031 

.014 

•  SABARS-Focus  In  vs.  Out 

-.032 

.017 

Step  3 

•  SABARS-Information  Gathering 

-.027 

.014 

•  SABARS-Focus  In  vs.  Out 

-.033 

.016 

•  SAG  AT-Awareness  of  Not  In  Communication 

.094 

.060 

Step  4 

•  SABARS-Information  Gathering 

-.018 

.013 

•  SABARS-Focus  In  vs.  Out 

-.050 

.016 

•  PSAQ-Self-Rated  Workload 

.054 

.022 

•  SAGAT-Awareness  of  Not  In  Communication 

.153 

Step  5 

•  SABARS-Focus  In  vs.  Out 

-.063 

.013 

•  PSAQ-Self-Rated  Workload 

.064 

.022 

•  SAGAT-Awareness  of  Not  In  Communication 

.175 

.059 

Step  6 

•  SABARS-Focus  In  vs.  Out 

-.071 

.613 

•  PSAQ-Self-Rated  Workload 

.076 

.021 

•  SAGAT-Awareness  of  Exposed  Friendlies 

.113 

.057 

•  SAGAT-Awareness  of  Not  In  Communication 

.198 

.057 

Step  7 

•  SABARS-Focus  In  vs.  Out 

-.071 

.013 

•  PSAQ-Self-Rated  Workload 

.063 

.023 

•  SAGAT-Awareness  of  Exposed  Friendlies 

.103 

.056 

•  SAGAT-Awareness  of  Advantage 

-.103 

.071 

•  SAGAT-Awareness  of  Not  In  Communication 

.212 

.056 

Note.  =  .37  for  Step  l.AR"=.ll  for  Step  2.  AR- =  .05  for  Step  S.  AR^  =  m  for 
Step  4,  AR^  =  -.03  for  Step  5,  AR^  =  .06  for  Step  6,  AR*  =  .03  for  Step  7  (p  <  .05). 


Subject  Feedback 


Subjects’  responses  to  the  Post-Experimental  Questionnaire  and  interviews  were 
analyzed  and  descriptive  statistics  computed.  The  major  points  are  summarized  below  by 
topic  area. 

Training  value  of  scenarios.  Subjects  rated  the  training  value  and  level  of 
challenge  provided  by  each  scenario.  Table  4  shows  that  all  scenarios  provided 
substantial  training  value.  Training  value  was  enhanced  by  the  overall  difficulty  and 
danger  inherent  in  the  scenarios,  unexpected  events,  non-perfect  performance  of  units  and 
weapons,  and  the  need  to  maintain  good  situation  awareness. 
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Not  surprisingly,  the  scenarios  were  also  perceived  as  very  challenging  with  the 
assault  scenario  rated  the  most  challenging  (almost  too  difficult)  and  the  defend  scenario 
viewed  as  the  least  challenging  (see  Table  5).  Subject  comments  indicated  that  the  level 
of  challenge  provided  by  the  scenarios  was  due  in  large  part  to  the  real-time  introduction 
of  multiple  events  and  threats  that  forced  the  individual  to  make  quick  and  accurate 
decisions. 

Separate  ANOVAs  were  performed  on  the  group  ratings  made  for  each  scenario. 
The  results  from  the  analyses  showed  that  the  inexperienced  and  experienced  groups  did 
not  differ  significantly  in  their  ratings  of  the  training  value  or  level  of  challenge  provided 
by  the  scenarios. 

Table  4 

Training  Value  Provided  By  Scenario 


Group 

Secure  Village/ 
SASO 

Assault 

Defend 

Secure  Village/ 
SASO 

Inexperienced 

M  =  3.57 

SD  =  .53 

M  =  3.86 

SD  =  .38 

M  =  3.71 

SD  =  .49 

M  =  4.00 

SD  =  .00 

Experienced 

M  =  3.83 

SD  =  .41 

M  =  3.86 

SD  =  .38 

M  =  3.67 

SD  =  .82 

M  =  3.86 

SD  =  .38 

Note.  1  =  No  training  value;  2  =  Some  training  value;  3  =  Moderate  training  value;  4  =  Significant  training 
value.  The  inexperienced  group  received  the  SASO  scenario  first  and  Secure  Village  scenario  last.  For  the 
experienced  group,  the  scenario  sequence  was  the  exact  opposite. 


Table  5 

Level  of  Challenge  Provided  By  Scenario 


Group 

Secure  Village/ 
SASO 

Assault 

Defend 

Secure  Village/ 
SASO 

Inexperienced 

M  =  3.29 

SD  =  .76 

M  =  3.71 

SD  =  .76 

M  =  3.00 

SD  =  .82 

M  =  3.43 

SD  =  .53 

Experienced 

M  =  3.17 

SD  =  1.17 

M  =  3.57 

SD  =  .53 

M  =  3.17 

SD  =  .98 

M  =  3.43 

SD  =  .79 

Note.  1  =  Not  very  challenging;  2  =  Reasonably  challenging;  3  =  Very  challenging;  4  =  Too  difficult.  The 
inexperienced  group  received  the  SASO  scenario  first  and  Secure  Village  scenario  last.  For  the 
experienced  group,  the  scenario  sequence  was  the  exact  opposite. 


Positive  training  features.  Subjects  listed  several  features  that  enhanced  the 
overall  value  of  the  training.  The  total  immersion  provided  by  the  SVS  enhanced  the 
overall  realism  of  the  scenarios.  All  scenarios  involved  a  fairly  high  operating  tempo  that 
required  quick  and  accurate  decisions  that  subjects  found  very  challenging.  In  addition, 
the  scenarios  contained  a  number  of  unexpected  events  or  developments  that  forced  the 
subject  to  maintain  a  heightened  level  of  vigilance  throughout  the  mission.  Finally, 
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subjects  could  see  the  immediate  consequences  of  their  actions  or  lack  of  action  (e.g., 
increased  number  of  friendly  casualties  from  delaying  order  to  cease-fire). 

Negative  training  features.  There  were  several  system  features  that  subjects  felt 
had  a  negative  impact  on  training.  For  some  subjects,  the  various  wires  that  were 
attached  to  the  rifle  and  headset  to  track  movement  and  allow  for  accurate  target 
engagement  constrained  movement  within  the  SVS.  Moving  glitches  were  also 
mentioned,  as  people  and  objects  moved  unexpectedly  or  unrealistically  within  or  out  of 
sight  on  the  screen.  The  thumbstick  located  on  the  rifle  was  seen  by  some  as  very 
awkward.  The  lack  of  “play”  in  the  thumbstick  made  it  very  difficult  for  subjects  to 
move  smoothly  in  the  virtual  environment.  Response  times  were  often  too  quick  (e.g., 
soldiers  moving  too  quickly  from  one  destination  to  another).  Finally,  the  system  did  not 
support  certain  key  combat  features,  such  as  the  tactical  use  of  smoke  during  the  assault 
mission. 

Suggestions  for  improved  training  effectiveness.  Some  of  the  suggestions  made 
by  the  subjects  were  clearly  tied  in  to  the  structure  and  format  of  the  scenarios.  Several 
soldiers  wanted  the  capability  to  sling  their  rifle  in  addition  to  having  a  more  integrated 
RTO  format.  The  nature  of  the  scenarios  required  that  the  subject  carry  his  map  in  one 
hand,  operate  the  radio  with  another  hand,  and  occasionally  move,  using  the  thumbstick, 
which  required  both  hands.  This  often  led  to  some  awkwardness  on  the  subject’s  part  as 
he  juggled  the  combination  of  material/equipment  depending  on  the  demands  of  the 
scenario. 

Some  subjects  also  indicated  that  they  wanted  to  be  able  to  move  with  the 
maneuver  element.  While  limited  movement  within  a  defined  area  was  acceptable, 
extensive  movement  was  discouraged  because,  based  on  past  observations,  subjects  who 
were  allowed  to  move  extensively  tended  to  either  get  lost  or  “stuck”  in  walls.  This 
could  affect  their  ability  to  focus  on  the  extensive  message  traffic  directed  their  way  and 
result  in  missed  training  cues.  This,  in  fact,  was  observed  twice,  and  the  subjects  suffered 
the  consequences  (e.g.,  killed,  lost  or  stuck).  Under  less  rigidly  developed  scenarios, 
allowing  the  subjects  to  move  with  their  maneuver  elements  would  have  some  merit. 

Overall,  this  virtual  environment  training  was  seen  as  particularly  effective  for  the 
inexperienced  lieutenant,  with  the  proviso  that  he  have  a  basic  knowledge  of  fundamental 
infantry  operations.  Virtual  decision  skills  training  was  viewed  by  some  subjects  as  the 
“walk”  phase  of  the  training  process  that  needs  to  be  combined  with  the  appropriate  field 
experience  (e.g.,  actual  training  time  at  the  McKenna  site)  and  mentoring  to  insure 
maximum  benefit. 

Using  virtual  environment  technologies  for  improving  decision-making  skills. 
Subjects  were  almost  unanimous  in  their  views  on  using  virtual  environment  technologies 
to  train  decision-making  skills.  Eighty-six  percent  (12/14)  of  the  subjects  felt  their 
decision-making  skills  had  improved  as  a  result  of  the  training  they  received.  All 
subjects  indicated  that  decision-making  skills  could  be  effectively  taught  using  virtual 
environment  technologies.  Finally,  ninety-three  percent  of  the  subjects  indicated  they 
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would  like  to  see  some  form  of  virtual  environment  decision-skills  training  included  in 
the  Infantry  Officer  Basic  Course  (lOBC)  curriculum. 

Discussion 

While  our  findings  are  preliminary,  the  pattern  of  results  obtained  suggests  that: 

1)  real-world  decision-making  skills  can  be  trained  in  virtual  environments;  2)  a  virtual 
environment  can  be  used  as  a  test  bed  for  developing  decision-making/SA  measures  and; 
3)  SA  appears  to  play  a  role  in  moderating  decision-making  accuracy  in  simulated 
dismounted  infantry  environments. 

Training  Real  World  Decision-Making  Skills  in  Virtual  Environments 

Assessing  decision-making  skills.  Based  on  objective  decision-point  data, 
performance  did  improve  (fewer  decision  errors)  from  trial  one  to  trial  four.  The 
curvilinear  pattern  of  improvement  depicted  in  Figure  1  was  unexpected,  however.  This 
relationship  could  be  scenario  dependent.  Both  groups  executed  the  assault  scenario 
during  trial  two.  This  scenario  was  rated  as  the  most  challenging  of  the  four  scenarios. 

In  fact,  the  high  ratings  (3.57  -  3.71,  on  a  four-point  scale)  suggest  that  for  some  subjects, 
the  scenario  bordered  on  the  too  difficult  side. 

The  presentation  of  scenarios  was  not  completely  counterbalanced.  As  noted 
earlier,  the  inexperienced  group  received  the  SASO  scenario  as  the  pre-test  and  the 
Secure  Village  as  the  post-test.  This  order  was  the  exact  opposite  for  the  experienced 
group.  Within  each  group  roughly  one-half  of  the  subjects  should  have  received  the 
SASO  as  the  pre-test  and  Secure  Village  as  the  post-test.  The  remaining  subjects  should 
have  received  the  same  scenarios  in  reverse  order. 

Subsequent  analyses  indicated  that  the  confound  of  scenario  order  (specifically 
trials  one  and  four)  within  groups  did  not  preclude  preliminary  assessments  concerning 
the  impact  of  the  training  on  decision-making.  The  experienced  and  inexperienced 
groups  did  not  differ  (significantly)  in  their  ratings  of  either  the  training  value  or  level  of 
challenge  provided  by  the  scenarios.  This  is  reflected  in  Figure  1  which  shows  that  the 
pattern  of  responses  over  trials  was  essentially  identical  for  both  groups.  The 
confounding  of  scenario  order  within  groups,  in  this  instance  at  least,  cannot  adequately 
explain  the  improvement  in  decision-making  between  trials  one  and  four. 

With  the  possible  exception  of  the  Execution  Scale,  none  of  the  subjective  paper- 
and-pencil  measures  of  leadership/decision-making  yielded  anything  of  substance.  There 
may  be  several  reasons  for  the  relative  insensitivity  of  the  measures.  First,  all  the  paper- 
and-pencil  measures  (e.g.,  the  Adequacy,  Initiative,  Intent,  Leader’s  Rationale,  Mission 
Performance,  as  well  as  the  Execution  Scales)  were  composed  predominantly  of  yes-no 
questions.  Only  the  global  rating  item  at  the  end  of  each  scale  included  a  multi  category, 
five-point  Likert  rating  format.  Some  raters  felt  that  they  could  have  made  finer 
discriminations  if  all  items  employed  this  same  format. 
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Second,  the  scenarios  may  have  also  contributed  to  rating  insensitivity  for  certain 
scales.  The  well-scripted  scenarios  left  little  room  for  major  discrepancies  among  plans 
that  could  be  observed  across  subjects  based  on  the  Adequacy  (of  the  plan)  Scale  ratings 
provided  by  the  0/C.  It  should  also  be  noted  that  planning  was  one  activity/process  that 
all  subjects,  experienced  and  inexperienced  alike,  had  been  exposed  to,  in  varying 
degrees  as  part  of  their  prior  training.  It  may  not  be  surprising  then,  that  all  subjects  had 
a  good  “feel”  for  the  planning  process  at  the  platoon  level.  This  may  have  further 
contributed  to  their  high  ratings  (in  the  “good”  range)  across  scenarios. 

Finally,  instruction  in  the  use  of  the  instruments  and  what  to  look  for  was  not 
stressed  enough  during  training  for  the  role  players  and  the  0/C.  The  biggest  concern 
during  training  was  insuring  that  all  role  players  had  learned  their  cues  concerning  when 
to  respond,  what  to  say,  and  how  to  synchronize  their  responses  with  others.  This  proved 
to  be  more  complex  than  initially  anticipated.  Not  surprisingly,  the  training  related  to 
how  to  use  the  rating  instruments  was  minimized.  More  emphasis  was  needed  in 
explaining  the  purpose  of  each  instrument,  pilot  testing  the  scales,  and  fine-tuning  the 
instruments  prior  to  the  experiment. 

Implementing  a  virtual  environment  training  system.  Subject  responses  were 
clearly  positive  regarding  the  use  of  virtual  environment  technologies  for  training 
decision-making  skills.  The  majority  of  subjects  felt  that  implementation  of  virtual 
environment  decision-skills  training  would  be  most  appropriate  at  the  lOBC  level. 
Implementation  at  this  level  does,  however,  present  some  problems.  One  problem  that 
must  be  addressed  is  class  size.  With  classes  of  up  to  250  and  more,  no  clear  solution 
could  be  devised,  during  post-experiment  interviews,  for  how  to  rotate  all  students 
through  a  limited  number  of  SVS  systems  and  still  insure  some  training  value.  All 
subjects  agreed  that  exposure  to  multiple  scenarios  was  critical  for  learning.  Most 
subjects  felt  they  would  have  to  execute  at  least  two  scenarios  to  derive  any  training 
benefit. 


Another  problem  is  the  necessity  of  having  some  type  of  automated  assessment 
system  to  track  subject  actions  over  key  decision  points  during  the  course  of  the  scenario, 
to  summarize  the  responses,  and  to  display  these  summary  data  quickly  after  the 
completion  of  a  trial  in  order  to  supplement  the  AAR  process. 

The  current  experiment  did  allow  subject  actions  to  be  tracked  over  time,  but 
summary  data  were  not  available  imtil  after  the  experiment  and  all  graphic  displays  had 
to  be  manually  created  by  the  experimenter.  Furthermore,  a  live  person  was  needed  to 
record  the  actions  of  the  subject;  this  could  not  be  accomplished  automatically.  In  the 
training  environment,  a  system  is  needed  to  free  an  instructor  from  having  to  manually 
enter  data  at  each  decision-point  and  would,  for  the  most  part,  automate  the  graphic  and 
tabular  summaries  of  the  data.  This  would  greatly  alleviate  the  training  burden  on  the 
instructor(s). 

Overall,  the  immersive  environment  created  by  the  SVS  systems  provided  the 
opportunity  to  simulate  conditions  similar  to  what  the  soldier  might  experience  in  the  real 
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world  (i.e.,  fluid,  dynamic  environments  that  required  quick,  rapid  decisions).  Soldiers 
were  clearly  challenged  and  they  could  both  see  and  hear  the  consequences  of  their 
actions  unfold  in  real  time  on  the  screen  and  in  subsequent  message  traffic  received  from 
the  squad  leaders,  platoon  sergeant,  and  the  company  commander.  Maybe  more 
importantly,  this  could  all  be  accomplished  in  a  safe  training  environment  where  subjects 
can  be  easily  regenerated  if  killed,  and  can  actually  profit  by  learning  from  poor  decisions 
made  in  earlier  scenarios. 

Using  the  Virtual  Environment  as  a  Test  Bed  for  SA  Instrument  Development 

As  noted  earlier,  one  reason  why  SA  has  not  been  as  thoroughly  researched  in 
dismounted  infantry  settings  as  opposed  to  other  settings  (e.g.,  aviation)  may  be  the 
difficulty  involved  in  employing  the  SAGAT  in  real  life  training  environments.  The 
majority  of  aviation  settings  employing  the  SAGAT  process  involve  simulation 
environments.  Under  these  conditions  the  researcher  has  more  control  of  events  and  the 
halts  are  not  as  disruptive  as  if,  for  example,  an  entire  platoon  field  training  exercise  were 
interrupted. 

In  field  exercises,  if  multiple  halts  are  intertwined  throughout  the  exercise,  precise 
control  of  action  (stops  and  starts)  can  be  difficult,  particularly  in  areas  where  the  platoon 
leader  is  not  present.  The  stopping  and  starting  can  also  seriously  degrade  the 
momentum  of  the  training.  Adding  to  the  disruption  is  the  fact  that  data  would  most 
likely  be  collected  from  just  the  platoon  leader,  while  the  rest  of  the  platoon  waited 
twenty  to  twenty-five  minutes  (total  time)  for  the  leader  to  complete  his  SAGAT 
questioning.  This  would  clearly  be  an  inefficient  use  of  field  training  time  for  the  rest  of 
the  platoon. 

Conducting  the  SAGAT  in  a  virtual  training  environment  was  far  more  efficient. 
Disruptions  were  relatively  minor.  Only  the  subject  was  inconvenienced  (if  at  all)  by  the 
breaks  in  the  action.  The  SAGAT  halts  were  not  a  major  distraction  for  the  role  players, 
data  collector,  or  technical  support  personnel.  The  relatively  controlled  setting  of  the 
LWTB  also  provided  an  ideal  work  environment  for  the  development  of  less  invasive 
subjective  paper-and-pencil  SA  measures  that  could  be  more  effectively  employed  in 
field  environments. 

One  of  the  key  research  objectives  in  this  area  was  to  compare  the  scores  on  the 
two  subjective  measures  with  scores  obtained  from  items  using  the  SAGAT  process.  The 
SAGAT  procedure  has  been  used  extensively  by  Endsley  (e.g.,  Strater,  Endsley,  Pleban, 

&  Matthews,  2001)  and  provides  valid,  objective  measures  of  individual  SA.  Based  on 
the  analyses  that  were  performed,  the  prediction  of  specific  SAGAT  responses  from 
SABARS  factor  scores  and  the  three  PSAQ  items  was  poor.  This  may  reflect  low 
predictiveness  of  some  of  the  SABARS  factors,  or  that  SABARS  and  SAGAT  are 
tapping  into  unrelated  aspects  of  SA.  It  may  also  reflect  the  relatively  small  sample  in 
the  experiment. 
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Inspection  of  the  item  content  from  both  the  SABARS  and  SAGAT  supports  the 
notion  that  both  instruments  are  addressing  different  aspects  of  SA.  SABARS  items 
focus  primarily  on  how  well  the  subject  acquires  and  disseminates  information  from 
different  sources.  SAGAT  items  focus  more  on  the  outcome  of  this  information 
processing,  i.e.,  locating  friendly  and  enemy  locations  on  a  map,  projecting  likely  actions 
of  friendlies/enemies  based  on  the  information  and  location.  While,  logically,  there 
should  be  some  connection  between  the  two  sets  of  measures,  it  is  possible  that  the  rigid 
structure  of  the  scenarios  minimized  the  variability  of  ratings,  particularly  the  0/C’s 
SABARS  ratings.  This,  in  turn,  may  have  attenuated  the  SABARS-SAGAT  relationship. 

PSAQ  items  focused  on  the  subject’s  self-ratings  of  SA,  workload,  and  quality  of 
work.  Workload  and  SA  did  relate  significantly  to  certain  SAGAT  items.  It  is  important 
to  note  that  subjects  received  immediate  feedback  on  their  actions  from  the  0/C  prior  to 
completing  the  PSAQ.  It  is  possible  that  the  0/C’s  comments  may  have  affected  their 
subsequent  SA  ratings  (e.g.,  making  the  subjects  aware  of  key  situational  cues  that  they 
may  have  missed).  This  could  explain,  to  some  degree,  why  both  groups’  self-ratings  of 
SA  were  fairly  high  across  trials.  In  summary,  while  the  relationships  observed  among 
the  three  SA  measures  were  modest  (but  significant)  additional  research  is  needed  to 
develop  a  clearer  linkage  between  these  measures  and  decision-making. 

Strater  et  al.  (2001)  provide  a  thorough  discussion  of  the  SAGAT,  SABARS  and 
PSAQ  and  implications  for  future  research  For  the  present  report,  the  main  objective 
was  to  show  that  a  virtual  environment  could,  in  fact,  serve  as  a  test  bed  for  the 
development  and  validation  of  SA  measurement  instruments.  In  this  case,  the  research 
performed  at  the  LWTB  provided  significant  insights  on  the  potential  utility  of  the 
different  measures  of  SA  and  highlighted  key  issues  for  further  investigation  (e.g., 
training  new  officers  how  to  effectively  assess  and  utilize  information  related  to  enemy 
disposition). 

The  Decision-Making/SA  Linkage 

Items  (factors)  from  all  three  SA  measures  contributed  significantly  to  the 
prediction  of  decision-making  accuracy.  Five  items  formed  one  of  the  SABARS  factors 
that  Strater  et  al.  (2001)  labeled  Focusing  Inside  the  Platoon  vs  Outside  the  Platoon. 
These  items  appear  tied  to  how  well  the  subject  acquires  (e.g..  Gathers  follow-up 
information  when  needed)  and  disseminates  (e.g..  Communicates  key  information  to 
commanding  officer)  information  within  his  platoon.  It  makes  sense  that  if  a  subject 
knows  what  information  to  ask  for,  can  discern  the  critical  information  from  reports, 
finds,  and  unusual  events  (items  addressed  by  this  factor),  his  SA  should  be  higher.  This 
should  lead  to,  among  other  things,  improved  decision-making  capability. 

The  cluster  of  items  composing  the  SABARS  factor  Focusing  Inside  the  Platoon 
Outside  the  Platoon  may  also  provide  some  valuable  insight  to  trainers  on  how  to 
effectively  tailor  a  training  program  to  improve  decision-making/SA  capabilities.  Many 
of  these  items  are  concerned  with  an  individual’s  ability  to  assess  the  importance  of 
various  pieces  of  information  from  much  larger  pools  of  information,  discern  critical 
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cues,  etc.  The  ability  to  read  cues,  and  understand  the  significance  of  these  cues  is  key  for 
making  rapid,  accurate  decisions  in  real  world  environments  and  forms  the  cornerstone  of 
the  work  presented  by  Klein  (1997)  and  Endsley  (1997). 

As  different  aspects  of  SA  undoubtedly  contribute  to  different  decisions  at 
different  times,  it  is  likely  that  different  SA  measures  would  be  related  more  to  individual 
decisions  rather  than  to  a  combined  decision  score  such  as  that  investigated  here.  This 
issue  should  be  explored  further. 

Overall,  these  results  are  consistent  with  previous  work  in  related  areas; 
nevertheless,  the  findings  should  be  viewed  as  preliminary.  Many  of  the  SA  scores  were 
inter-correlated,  which  can  affect  the  degree  to  which  factors  will  appear  as  significant 
within  a  step-wise  regression  (see  Strater,  Endsley,  Pleban,  and  Matthews,  2001). 
Moreover,  the  results  from  both  the  regressions  and  the  factor  analysis  conducted  on  the 
SABARS  should  be  interpreted  cautiously  given  the  sample  size  of  the  present  study.  To 
more  thoroughly  investigate  the  relationship  between  aspects  of  SA  and  decision-making 
effectiveness  would  require  a  larger  study  with  more  subjects  and  a  wider  range  of 
scenarios  (counterbalancing  the  order  of  scenario  administration  across  subjects)  and 
decision  types.  Ultimately,  there  should  be  some  demonstration  that  virtual  decision/SA 
skills  training  effects  transfer  to  similar  real  world  scenarios. 

With  these  caveats  in  mind,  these  results  indicate  that  there  was  some  degree  of 
predictiveness  associated  with  this  subset  of  the  S  A  measures  taken  and  the  decision 
scores  analyzed  here.  This  finding  would  indicate  that  further  work  in  examining  SA  and 
its  effect  on  military  decision-making  is  warranted. 

Conclusion 

This  research  showed  that  real  world  decision-making  skills  could  be  trained  using 
virtual  technologies.  While  the  design/format  was  too  resource  intensive  (number  of 
SVSs  used,  large  support  base-system  maintenance  personnel,  confederates,  poor 
automated  data  collection,  tracking  and  analysis  capability)  for  efficiently  training  one 
soldier,  a  number  of  partial  solutions  are  possible.  For  example,  instead  of  training  only 
one  soldier  at  a  time,  a  group  of  soldiers  (five)  could  be  trained.  This  would  require 
changing  the  structure  of  the  scenarios,  e.g.,  (less  rigid  scripting,  and  inserting  additional 
subjects  into  role  player  positions).  Efforts  are  also  underway  to  automate  the  data 
collection/  tracking/analysis  capability  of  the  system  to  make  it  more  user  friendly  for 
trainers. 

From  an  organizational/institutional  standpoint,  implementation  of  virtual  training 
technologies  into  a  formal  course  curriculum  (i.e.,  lOBC)  may  not  be  feasible  at  this  time. 
A  number  of  questions  must  be  answered.  For  example,  would  any  subject  areas  have  to 
be  modified  or  removed  from  the  curriculum?  If  yes,  which  ones?  How  would  this 
process  be  determined?  How  could  this  training  be  introduced  to  insure  maximum 
training  value  for  the  soldier?  As  mentioned  earlier,  soldiers  would  require  multiple 
exposures  to  different  scenarios  to  receive  any  training  benefit.  Would  lOBC  course 
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developers  be  willing  to  make  the  necessary  cuts/modifications  in  their  current  course 
curriculum  to  insure  adequate  training  time  in  the  simulators?  Thus,  while  virtual 
environment  technologies,  in  concept,  can  be  a  potent  tool  for  training  decision-making 
skills,  there  are  still  many  pragmatic  concerns  that  must  addressed  before  this  type  of 
training  is  incorporated  in  formal  school  (e.g.,  lOBC)  instruction. 

From  a  feasibility  standpoint,  these  virtual  environment  technologies  may  be 
more  suitably  employed  at  the  unit  level  for  select  elements  (e.g.,  special  operations 
forces).  These  systems  can  be  effectively  used  during  mission  rehearsal  activities 
(Pleban,  Eakin,  &  Salter,  2000)  or  as  an  aid  to  enhance  the  AAR  process  (see  Clancy, 
1998). 


The  present  research  has  shown  that  a  virtual  environment  can  be  used  as  a  test 
bed  for  the  development  of  SA  measurement  instruments.  It  can  also  serve  as  an 
effective  medium  for  conducting  both  basic  and  applied  research  in  decision-making  and 
SA.  Valuable  insights  were  obtained  on  how  to  refine  training  procedures  for  improving 
real  world  decision-making  skills.  In  addition,  conducting  research  in  the  controlled 
setting  of  the  LWTB  permitted  closer  empirical  scrutiny  of  the  linkage  between  decision¬ 
making  and  situation  awareness  in  dismounted  infantry  operations  and  suggested  new 
directions  for  further  work  in  these  areas. 
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Appendix  A 

Biographical  Information  Questionnaire 


Name _  Unit _  Date _ 

Please  fill  in  the  blank  or  mark  or  circle  the  appropriate  response. 

1 .  What  is  your  age?  _ Years 

2.  MOS _ 

3.  Rank _ 

4.  Time  in  service  Years _  Months _ 

5.  What  is  the  source  of  your  commission? 

_ ROTC  _ USMA _ OCS 

6.  What  is  your  current  (or  most  recent)  duty  position?  _ 

How  long  in  this  position?  _ 

7.  What  Army  training  courses  have  you  completed?  Check  all  that  apply. 

_ OSUT/AIT  _ PLDC  _ BNCOC  _ lOBC 

_ BFV  Leader  Course  _ Airborne  _ Ranger 

_ ^Air  Assault _ Combat  Life  Saver  Course 

_ Other  (please  specify) _ 

8.  How  susceptible  to  motion  or  car  sickness  do  you  feel  you  are? 


1  2 

3  4  5 

6 

7 

not 

moderately 

highly 

susceptible 

susceptible 

susceptible 

9.  Do  you  have  normal  or  corrected  to  normal  20/20  vision?  _ ^Yes 
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No 


10.  Are  you  color  blind?  _ ^Yes _ No 

11.  Are  you  _ right  handed?  _ left  handed? 

12.  My  level  of  confidence  in  using  computers  is 

1  2  3  4  5 

low  average  high 

1 3.  How  many  hours  per  week  do  you  use  computers?  _ hours  per  week 

14.  How  many  times  in  the  last  year  have  you  experienced  a  virtual  reality  game 
or  entertainment? 

0  1  2  3  4  5  6  7  8  9  10  11  12+ 

15.  How  often  have  you  trained  at  the  McKenna  MOUT  site  (not  including 
demos)? 

_ not  since  basic  training  _ 1  -3  times  _ more  than  3  times 

16.  Have  you  ever  been  in  a  Virtual  Individual  Combatant  (VIC)  simulator  at  the 
Land  Warrior  Test  Bed  before? 

_ ^Yes  _ No 

If  YES,  which  one(s)?  (Describe  if  you  cannot  remember  the  name) 


17.  Have  you  had  any  other  experience  with  military  computer  simulations? 
_ ^Yes _ No 

If  yes,  please  describe  briefly  or  give  the  names  of  the  simulators. 
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Appendix  B 


Subject  Name _  Date 


Adequacy  of  the  Plan 

Rate  the  adequacy  of  the  plan  based  on  the  following  characteristics. 

Yes 

No 

•  Mission  statement  clearly  identified,  i.e,,  who,  what,  when,  where, 
and  why. 

•  Mission  statement  included  an  end  state,  i.e.,  how  things  should  look 
when  the  mission  is  complete. 

•  Provided  the  appropriate  level  of  detail  for  the  situation. 

•  Recognized  and  utilized  available  terrain  and  resources. 

•  Provided  a  feasible  approach  for  the  situation. 

•  Assumed  a  thinking  enemy. 

•  Analyzed  the  enemy. 

•  The  plan  was  decisive. 

•  The  plan  was  easy  to  understand. 

•  The  platoon  leader’s  plan  reflected  a  clear  understanding  of  all  relevant 
mission  factors. 

! 

•  Overall,  how  would  you  rate  the  plan? 

Very  Good  Good  Borderline  Poor  Very  Poor 

Comments: 
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Appendix  C 


Subject  Name _  Date 


Appropriate  Level  of  Initiative 

Rate  the  level  of  initiative  demonstrated  by  the  platoon  leader  based  on  the 
following  actions. 

Yes 

No 

•  Decisions  were  made  in  a  timely  fashion. 

•  The  platoon  leader  was  able  to  recognize  and  define  emerging  problems. 

•  The  platoon  leader  involved  the  squad  leaders  in  decisions  where 
appropriate. 

•  Platoon  leader  actions  were  appropriate  for  the  situation. 

•  The  platoon  leader  remained  decisive  throughout  the  mission. 

•  The  platoon  leader  took  control  of  the  situation  without  delaying  and 
waiting  for  orders. 

•  The  platoon  leader  was  able  to  improvise  within  the  commander’s 
intent. 

•  The  platoon  leader  was  able  to  work  effectively  in  a  fluid  environment. 

•  Overall,  how  would  you  rate  the  level  of  initiative  demonstrated  by  the  platoon  leader? 

Very  Good  Good  Borderline  Poor  Verv  Poor 

Comments: 
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Appendix  D 


Subject  Name _  Date 


Plan’s  Fit  within  Commander’s  Intent 

Rate  the  platoon  leader’s  ability  to  tailor  his  plan  within  the  larger  plan 
presented. 

Yes 

No 

•  The  platoon  leader  understood  that  his  platoon  is  part  of  a  larger  unit 
and  acted  accordingly. 

•  Actions  were  taken  based  on  the  intent  of  higher  command. 

•  The  plan  considered  other  friendly  units. 

•  How  well  did  the  platoon  leader’s  plan  fit  within  the  scope  of  the  commander’s  intent? 

Very  Good  Good  Borderline  Poor  Very  Poor 

Comments: 
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Subject  Name _  Date 


Leader’s  Rationale 

Yes 

No 

•  Decisions  were  based  on  a  reasonable  assessment  of  the  enemy. 

•  The  platoon  leader  understood  the  strengths/weaknesses  of  his  situation. 

•  The  platoon  leader’s  actions  reflected  his  understanding  of  the 
opportunities  and  dangers  of  the  situation. 

•  The  reasons  behind  the  platoon  leader’s  actions  were  sound. 

•  How  would  you  rate  the  platoon  leader’s  overall  understanding  of  the  situation? 

Very  Good  Good  Borderline  Poor  Very  Poor 

Comments: 
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Subject  Name _  Date 


Mission  Performance 

Yes 

No 

•  Was  the  mission  accomplished? 

•  Were  excessive  casualties  taken  in  the  execution  of  the  mission? 

•  Were  excessive  civilian  casualties  taken  in  the  execution  of  the  mission? 

•  Was  the  mission  accomplished  in  a  timely  fashion? 

•  Overall,  how  would  you  rate  the  performance  of  the  mission? 

Very  Good  Good  Borderline  Poor  Very  Poor 

Comments: 
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Appendix  G 


Subject  Name _  Date 


Execution 

Yes 

No 

•  Were  orders  clear? 

•  Were  the  instructions  simple  and  sufficient  given  the  circumstances? 

•  Did  you  understand  what  the  platoon  leader  was  trying  to  accomplish? 

•  Overall,  how  would  you  rate  the  execution  of  the  plan? 

Very  Good  Good  Borderline  Poor  Very  Poor 

Comments: 


G-1 


Appendix  H 

Situation  Awareness  Behaviorally  Anchored  Rating  Scale  (SA  BARS) 
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Appendix  I 
SAGAT 

(Computerized  version  for  platoon  leaders) 


SAGAT  INSTRUCTIONS  TO  SUBJECTS 


Situation  awareness  (SA)  is  critical  to  directing  and  executing  Infantry  operations. 
For  the  purpose  of  this  test,  situation  awareness  is  formally  defined  as:  the  perception  of 
the  elements  in  the  environment  within  a  volume  of  time  and  space,  the  comprehension  of 
their  meaning,  and  the  projection  of  their  status  in  the  near  future.  This  means  your 
perception  of  what  is  happening  in  the  situation,  including  friendly,  enemy,  neutral,  and 
non-combatant  disposition,  actions  and  intentions,  and  what  that  all  means  to  you  as  a 
platoon  leader. 

The  Situation  Awareness  Global  Assessment  Technique  (SAGAT)  has  been 
developed  to  objectively  measure  situation  awareness  (SA)  in  manned  simulations. 

•  During  the  trial,  the  simulation  will  be  frozen  at  randomly  determined  intervals  and 
the  visual  scene  blanked. 

•  You  will  be  asked  about  your  knowledge  of  specific  SA  components,  as  you  perceive 
them,  at  that  point  in  time. 

•  The  questions  will  be  presented  on  a  PC.  The  questions  have  been  created  to  allow  for 
quick  and  easy  data  input  using  the  cursor. 

•  You  will  not  be  allowed  to  talk  to  anyone  other  than  the  Test  Director  when 
completing  the  questions. 

•  The  questions  should  be  answered  as  rapidly  as  possible. 

•  Even  if  you  do  not  know  some  of  the  information  exactly,  you  should  make  your  best 
guess.  There  is  no  penalty  for  guessing.  If  you  really  have  no  idea  at  all  of  the 
answer  to  a  question,  you  may  simply  click  on  the  "done"  box  on  the  screen  to  go  on 
to  the  next  question.  You  are  generally  better  off  making  your  best  guess,  however. 

•  Following  the  SAGAT  session  you  will  resume  the  trial  exactly  where  you  left  off. 
You  will  turn  around  and  when  ready  the  simulation  will  be  resumed. 

The  purpose  of  SAGAT  is  to  evaluate  systems  and  training  concepts,  not  to 
evaluate  you  as  an  individual.  You  may  not  be  able  to  answer  many  of  the  questions  you 
will  be  asked.  Don’t  worry  about  this,  as  the  questions  are  intended  to  assess  ideal  SA. 
Some  of  this  information  may  not  be  available  or  may  not  be  adequately  accurate. 

You  will  have  the  opportunity  to  practice  answering  the  SAGAT  questions  before 
testing  begins.  Please  direct  any  questions  you  may  have  to  the  Test  Director. 
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Close 


S-1,T-1,  Stop-1 


To  begin  the  program  click  on  the  button  marked  “START  SAGAT”. 
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1  Done  I 


Click  on  the  symbol  next  to  each  element  that  is  currently  alive  and  present  in  the 
battlefield  and  drag  it  to  its  current  location.  (You  may  move  the  symbols  on  the  map  if 
they  are  not  placed  correctly).  Indicate  the  location  of  yourself,  your  commander,  the 
main  squad  locations  (with  their  squad  leader),  weapons  squad  location  and  any  teams 
that  have  become  detached  from  their  main  squads  and  are  located  separately.  In 
addition  indicate  the  location  of  any  known  enemies,  enemy  heavy  weapons  locations, 
other  friendly  units  (outside  of  your  platoon)  and  civilians.  Click  on  the  Done  button 
when  you  are  finished  indicating  the  location  of  all  known  parties. 


1-3 


9 


The  location  of  all  the  elements  you  indicated  in  the  first  question  are  presented  on  the 
left.  Click  on  the  button  that  corresponds  to  the  enemy  unit  that  is  the  highest  level  threat 
to  your  platoon  at  this  time.  Click  on  the  Done  button  when  you  are  finished. 
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The  location  of  all  the  elements  you  indicated  in  the  first  question  are  presented  on  the 
left.  Click  on  the  button(s)  that  corresponds  to  the  enemy  units  with  the  weakest 
locations  at  this  time.  You  may  indicate  more  than  one.  Click  on  the  Done  button  when 
you  are  finished. 
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r  Which  enemy 
i  locations  are 
jthe- 

:  strongest? 


The  location  of  all  the  elements  you  indicated  in  the  first  question  are  presented  on  the 
left.  Click  on  the  button(s)  that  corresponds  to  the  friendly  units  with  the  weakest 
locations  at  this  time.  You  may  indicate  more  than  one.  Click  on  the  Done  button  when 
you  are  finished. 
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'  Done 


The  location  of  all  the  elements  you  indicated  in  the  first  question  are  presented  on  the 
left.  Click  on  the  button(s)  that  corresponds  to  the  friendly  units  with  the  strongest 
locations  at  this  time.  You  may  indicate  more  than  one.  Click  on  the  Done  button  when 
you  are  finished. 


9 


'm,  Kenna 


Which  friendly 
forces  are 
currently  exposed 
to  enemy 
firetettack? 


i 


ij  Done  j 


The  locations  of  all  the  elements  you  indicated  in  the  first  question  are  presented  on  the 
left.  Click  on  the  button(s)  that  corresponds  to  the  friendly  units  who  are  currently 
exposed  to  enemy  fire/attack.  You  may  indicate  more  than  one.  Click  on  the  Done  button 
when  finished. 
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HI^E3 


Does  the  enemy  know  the  location  of  your  platoon? 


Indicate  whether  any  enemy  troops  currently  are  aware  of  your  location  or  that  of  any  of 
your  platoon.  Click  on  the  OK  button  when  you  are  done. 
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Q 


How  many  casualties  has  your  platoon  suffered? 


imei 


(Click  on  arrow  and  select  number  from  list) 


EE) 

▼ 

8 

9 

10 

11 

12 

14 

15 

OK 


Indicate  how  many  casualties  your  platoon  has  suffered  up  to  this  point  by  using  the  pull 
down  menu.  Click  on  the  OK  button  when  you  are  done. 


I-ll 


tlliiE3 


What  do  you  expect  the  enemy  to  do  in  the  next  five  minutes? 


(Select  all  that  apply) 


Indicate  what  actions  you  expect  the  enemy  troops  in  this  scenario  to  take  in  the  next  five 
minutes.  Click  on  the  OK  button  when  you  are  done. 
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a 


What  do  you  expect  civilians  to  do  in  the  next  five  minutes? 


IMEi 


(Select  ail  that  apply) 


Become 

hostile 


Form  a 
crowd 


Move 

positions 


RioVAtiack 


Disperse 


Other 


Get  in  the 
way 


Nothing 


Indicate  what  actions  you  expect  the  civilians  in  this  scenario  to  take  in  the  next  five 
minutes.  Click  on  the  OK  button  when  you  are  done. 
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Who  has  the  advantage  in  the  current  situation? 


Friendly 

Troops 


Enemy 

Troops 


Neither 


Indicate  whether  friendly  or  enemy  troops  (or  neither)  currently  have  the  advantage  by 
clicking  on  the  appropriate  button.  Click  on  the  OK  button  when  you  are  done. 
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1 

Q 


Which  friendly  elements  are  not  in  communication  with  you? 


(Select  all  that  apply) 


Squad  1 


Squad  3 


Detached 

Troops 


Squad  2 


1  \ 

1  Weapons  j 

Supporting 

Other 

1  Squad  | 

!  : 

units 

platoons 

None 


OK 


Indicate  whether  any  of  the  above  friendly  troops  have  lost  communications  with  you.  If 
all  are  in  communication  with  you,  click  on  the  None  button.  Click  on  the  OK  button 
when  you  are  done. 
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SAGAT 

(Paper-and-pencil  version  for  company  commander) 

Participant _  Scenario _  Stop  Number 

SAGAT  -  Expert  Rating  Form 

Based  on  having  perfect  knowledge  of  the  situation: 

2.  Indicate  the  highest  level  threat  (to  the  participant)  with  an  X 

4.  Indicate  the  weakest  enemy  locations  with  a  O 

5.  Indicate  the  strongest  enemy  locations  with  a  S 


ENEMY  INFORMATION 


Note.  Buildings  in  actual  map  used  by  company  commander  are  white  and  labeled.  Original  map  drawing 
did  not  replicate  clearly.  This  is  an  actual  slide  of  the  McKenna  area  where  scenarios  were  executed. 


M6 


Based  on  having  perfect  knowledge  of  the  situation: 

6.  Indicate  the  weakest  friendly  locations  with  a  O. 

7.  Indicate  the  strongest  friendly  positions  with  a  S. 

9.  Indicate  which  friendly  positions  are  exposed  to  enemy  fire/attack  with  an  F 

14.  Indicate  where  there  are  troops  in  locations  that  do  NOT  offer  concealment  with  a 
NC. 

15.  Indicate  where  there  are  troops  in  locations  that  do  NOT  offer  cover  with  a  NV. 


FRIENDLY  INFORMATION 


Note.  Buildings  in  actual  map  used  by  company  commander  are  white  and  labeled.  Original  map  drawing 
did  not  replicate  clearly.  This  is  an  actual  slide  of  the  McKenna  area  where  scenarios  were  executed. 
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Based  on  having  perfect  knowledge  of  the  situation: 


3.  Can  all  assigned  squad  tasks  be  accomplished  within  the  time  requirements? 
YES  NO 

12.  Does  the  enemy  know  where  the  friendly  platoon  is  at? 

YES  NO 

16.  How  many  casualties  have  the  friendlies  suffered? _ 

17.  What  do  you  expect  the  enemy  to  do  in  the  next  5  minutes? 

Attack 

Nothing 

Move  positions 

Defend 

Retreat 

Other 

18.  What  do  you  expect  civilians  to  do  in  the  next  5  minutes? 

Become  hostile 
Riot/attack 
Form  a  crowd 
Disperse 
Nothing 
Move  positions 
Get  in  the  way 
Other 

1 9.  Who  has  the  advantage  in  the  current  situation? 

Friendly  troops 
Enemy  troops 

Friendly  and  enemy  troops  equal 

20.  For  which  friendly  element  are  plans  not  being  executed  as  per  orders? 

Squad  1 
Squad  2 
Squad  3 
Weapons  squad 
Other  platoons 
Supporting  units 
None 

21.  Which  friendly  elements  are  not  in  communication  with  the  platoon  leader? 

Squad  1 
Squad  2 
Squad  3 
Weapons  squad 
Other  platoons 
Supporting  units 
None 
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Appendix  J 

Post  Trial  Participant  Subjective  SA  Questionnaire 

Participant _ 

Scenario _ 

Date _ 


1 .  Please  circle  the  number  below  that  best  1  2  3  4  5  ®^tremely 

describes  how  hard  you  were  working  hard 

during  this  scenario. 

Comments: 


2.  Please  circle  the  number  that  best  describes  Extremely  1  2  3  4  5  extremely 

how  well  you  performed  during  this  scenario  well 

Comments: 


3.  Please  circle  the  number  that  best  describes  Not  aware  \  2  3  4  5  Completely 

how  aware  of  the  evolving  situation  you  of  situation  aware  of 

were  during  the  scenario.  situation 

Comments: 
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Appendix  K 

Post  Experiment  Questionnaire 


Name 


Date 


1 .  Rate  the  training  value  of  each  scenario  listed  below. 

(Use  the  following  scale:  1=No  training  value;  2=Some  training  value; 
3=Moderate  training  value;  4=Significant  training  value). 

_ Defend  town 

_ Company  assault 

_ SASO  civil  disturbance 

_ Secure  village/Downed  aircraft 

Briefly  explain  your  ratings. 


2.  How  challenging  did  you  find  each  of  the  scenarios  listed  below. 

(Use  the  following  scale:  1=Not  very  challenging;  2=Reasonably  challenging; 
3=Very  challenging;  4=Too  difficult). 

_ Defend  town 

_ Company  assault 

_ SASO  civil  disturbance 

_ Secure  village/Downed  aircraft 

Briefly  explain  your  ratings. 


3.  What  did  you  like  most  about  the  training? 
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4.  What  did  you  like  least  about  the  training? 


5.  Based  on  your  experiences  today,  what  suggestions  do  you  have  for  making 
this  type  of  training  more  effective? 


6.  Do  you  feel  that  your  decision-making  skills  improved  as  a  result  of  the 
training  you  received? 

_ Yes  _ No 

Briefly  explain  your  answer. 


7.  Do  you  think  that  decision-making  skills  can  be  effectively  taught  using  virtual 
environment  technologies? 

_ ^Yes  _ No 

Briefly  explain  your  answer. 


8.  Would  you  like  to  see  some  form  of  virtual  environment  decision-skills  training 
included  in  the  lOBC  curriculum? 

_ Yes  _ No 

Briefly  explain  your  answer. 
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Appendix  L 

Scenario  A:  SASO-Civil  Disturbance 

1.  Co  A,  1-1 1th  Infantry  is  in  the  first  day  of  occupying  the  town  of  Kenna. 
The  company  has  the  mission  to  defend  the  town.  The  enemy  presence  is 
considered  light,  capable  of  conducting  military  operations  in  the  immediate 
region  with  insurgent  forces  less  than  platoon-size,  possibly  supported  by 
mortars.  There  is  no  heavy  threat.  Last  reported  enemy  activity  in  the 
region  was  a  terrorist  bombing  conducted  in  the  neighboring  town  of  Polo, 

3  kilometers  to  the  northwest,  3  days  ago.  The  town  population  of  Kenna  is 
considered  to  be  overall  friendly.  However,  there  may  be  insurgents  and 
insurgent  sympathizers  within  the  town's  population. 

2.  The  company  has  established  defensive  positions  with  1st  and  3d 
Platoons  defending  the  town  from  selected  positions  in  buildings  along  the 
perimeter  of  the  town.  1st  Platoon  is  in  the  east.  3d  Platoon  is  in  the  west. 
Your  platoon,  the  2d  Platoon,  is  to  establish  1  squad-sized  roving  patrol 
within  the  town.  Your  other  2  squads  are  held  as  the  company  reserve. 

The  company  commander  selected  the  north  side  of  BLDG  A4  as  your 
platoon  CP  location.  He  has  directed  that  all  platoon  leaders  remain  in  the 
general  vicinity  of  their  respective  CPs  for  communications  purposes.  He 
has  directed  that  the  platoons  use  their  platoon  sergeants  as  much  as 
possible  to  realign  positions,  if  necessary.  The  company  CP  is  in  the  north 
side  of  BLDG  N. 

3.  Your  platoon  has  3  rifle  squads  and  1  weapons  squad.  The  Weapons 
Squad  Leader,  SSG  Castro,  is  presently  in  the  hospital  recovering  from 
wounds.  Since  the  Weapons  Squad  has  no  team  leaders,  you  have  cross- 
attached  the  Weapons  Squad  to  the  3  line  squads. 

4.  The  2d  Platoon  has  been  in  position  for  6  hours.  1st  Squad  is  currently 
positioned  in  BLDG  Eb,  and  2d  and  3d  Squads  are  located  in  BLDG  L. 

5.  The  company  executive  officer  is  injured  and  is  currently  seeking 
emergency  medical  treatment.  He  is  expected  back  later  today.  You  are 
the  senior  platoon  leader. 
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6.  Ration  cycle  is  C,  C,  T.  MEDEVAC  is  restricted  to  escorted  ground 
ambulances.  Ambulances  are  coordinated  through  the  company 
commander.  Injured  civilians  will  receive  medical  assistance.  Captured 
enemy  personnel  or  civilian  detainees  will  be  handled  through  company 
channels. 

7.  Rules  of  Engagement  (ROE).  Since  the  overall  town  population  is 
considered  friendly,  the  rules  of  engagement  are  very  restrictive.  There  will 
be  no  weapon  firing  within  the  town  limits  except  in  self-defense  or  in 
defense  of  the  town  against  a  confirmed  enemy  presence.  Self-defense  is 
defined  as  a  serious  threat  to  life  or  limb.  A  serious  threat  is  considered 
gunfire  or  the  presence  of  an  uncontrolled  mob  armed  with  life-threatening 
weapons  such  as  knives,  pikes,  metal  poles,  etc.  Every  effort  must  be 
made  to  disarm  the  situation  prior  to  the  use  of  deadly  force.  Weapons 
control  status  is  white. 

8.  Your  immediate  task  is  to  select  a  squad  to  conduct  the  roving  patrol 
and  brief  your  squad  leaders. 

9.  What  are  your  questions? 

10.  The  scenario  will  begin  once  you  have  briefed  your  platoon,  the  squad¬ 
sized  roving  patrol  is  preparing  to  deploy,  and  you  have  occupied  your  CP 
location. 
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Scenario  A:  SASO-Civil  Disturbance,  2d  PIT  Mission 


Scenario  begins  w/ 
PLT  conducting  1 
SQD-sized  patrol  2 
SQDs  in  resen/e. 


CDR  states  3d  PLT  reports 
angry  civilians  forming  invic. 
BLDGE.  CDR  orders  2d  PLT 
to  send  SQD  to  investigate. 
CDR  reminds  LT  of  ROE 
status.  Retain  roving  patrol. 


1.  CDR  asks  for  SITREP. 

_ ^  FREEZE 

2,  CDR  again  asks  for  SITREP. 

3,  CDR  repeats  order. 

FRAME 

;  CDR  guidance 


1st  PLT  mission  -securing  tov^n 
2d  PLT  mission  -1  SQD  roving  patrol 
with  other  2  SQDs  in  reserve. 

3d  PLT  mission  -secunng  town 
XO  seeking  emergency  medical 
treatment  but  2d  PLT  LDR  is  senior  LT 
in  company 

XO  injured  but  is  expected  back  later 
today 

CDR  mandates  PLT  CP  North  side 
BLDG  A4 

CDR  CP  -  North  side  of  BLDG  N 
1st  SQD  LDR  with  PLT  less  than  20 
days 

MEDEVAC  (ground)  thru  CDR 
No  other  attachments 
Light  enemy  presence 
No  heavy  threat 
Population  overall  is  friendly 


COMPUTER  CUE:  Have  56  SAP  civilians  milling  around 
along  North  side  of  BLDG  E.  If  1st  SQD  is  tasked  show 
SQD  moving  East  from  the  North  side  of  BLDG  E  along 
road  between BLDGsA4  &  L.  2d  or  3d  SQD  move  from 
south  side  of  BLDG  L.  Unless  on  patrol.  2d  and  3cSQDs 
will  move  from  south  side  BLDG  L.  then  betweerBLDGs 
J2  and  N.  then  to  north  side  of  BLDG  E. 


1b.  ROE 
not 

discussed. 


1c,  Sends 
;  1st  SQD, 


Id.  Report 
not  required. 


Tasked  SQD  LDR  radios  PSG. 
Reports  he  stopped  one  of  his 
soldiers  from  hitting  a  civilian  who 
was  swearing  at  his  troops. 

Wants  to  know  since  a  slap  is  not 
deadly  force,  can  he  just  look  the 
other  way  next  time. 


PSG  slates  negative.  Overall  population 
is  considered  friendly.  If  civilians  get 
physical,  restrain  them,  but  use  of  deadly 
force  is  not  authorized  unless  in  self 
defense.  States  he’ll  have  the  hide  of  the 
first  SQD  LDR  that  creates  an  incident. 


PSG  reminds  LT 
1st  SQD  LDR  is 
new  and  doesn’t 
know  the  code 
words  in  the  SOP. 
Recommends 
sending  another 
SQD. 


Tasked  SQD 
acknowledges  mission. 
Begins  radio  silence. 


+2  minutes,  CDR 
asks  for  SITREP.  If 
LT  reports  no  problem 
-  CDR  reports  he 
can’t  see  anyone  near 
civilians  from  his 
location-check  on  it. 


1.  LT  should  send  2d  or  3dSQDs  -  1st  SQD 
inexperienced. 

2.  Requires  reporting  procedures  once  on  site. 

3.  ROE  must  be  discussed. 

4.  LT  should  not  send  roving  patrol. 

5.  Notify  CDR  of  movement. 


la.  Fails  to 
notify  CDR. 


If.  Successfully 
completes  task 
not  anticipated. 


1e.  LT  sends 
roving  patrol. 


ig- 

Completes 
all  tasks. 


-►1  minute.  CDR 
asks  for  SITREP. 
Reminds  LT  that 
he  expects 
SITRcP  when  he 
gives  an  order. 


+2  minutes.  CDR  asks  for  SITREP. 
Upset  that  roving  patrol  was  tasked. 
States  its  too  late  to  change  SQDs. 


LT  contacts  _  SQD  LDR  responds  that  he 
tasked  SQD.  'S  observing  avilians.  Did  not 
know  he  was  to  report  back 
information.  SITREP-  no 
violence  just  milting  around. 


If  LT  persists,  PSG  reminds  LT  that  we  cannot  report  possible  incidents  in  the  clear.  Then  ■ 
CDR  comes  on  line.  States  he  monitored  conversation.  PSG  is  correct.  Send  another  SQ[l 


PSG  calls  LT.  Asks  if  he  monitored  conversation.  Reminds  LT  that  ROE  must  be  discussed  as  part  of  each  mission.  Situation  is  too  volatile  not  i 


CDR  guidance 


1.  CDR  asks  for  SITREP. 

2.  CDR  again  asks  for  SITREP. 

3.  CDR  repeats  order. 


2b.  Sends  one  of  the  nondeployed  reserve  SQDs. 


2c.  Sends  roving  patrol. 


PSG  reminds  LT  that  CDR 
wants  roving  patrol  retained 
as  an  immediate  action 
force.  Recommends  using 
another  SQD. 


1.  Sends  one  of  the  nor>deployed  resen/eSQOs. 

2.  Retains  roving  patrol. 

3.  Notifies  CDR  of  movement 


Fails  or  hesitates 
.  to  act 


/  PLT  \ 
.»►/  LDR 
N^CTION / 
SendX.  2  / 

.  SQD  \/ 


CDR  states  1st  PLT 
reports  civilians 
departing  townvic. 
BLDGsG&  J1. 
CDR  orders  2d  PLT 
to  send  SQD  to 
investigate. 


2a.  LT  fails  to 
notify  CDR. 


2d.  Successfully 
completes  task 
not  anticipated. 


2e.  Sends  one  of  the  non 
deployed  reserveSQDs 
and  completes  all  tasks. 


COMPUTER  CUE;  Display  1012  SAF 
civilians  departing  along  route.  Have 
bodies  move  from  north  side  of  BLDG 
J2  to  intersection  at  BLDGs  Gc  and  J1 . 
then  move  north  out  of  town. 


If  LT  persists,  at  +30  seconds, 
CDR  calls  wanting  SITREP. 
Reminds  LT  not  to  use  roving 
patrol. 


+2  minutes,  CDR  asks  for 
SITREP.  Won’t  remind  LT 
of  reporting  requirement 
again. 


Tasked  SQD  LDR  acknowledges  mission. 


COMPUTER  CUE;  Display  SAF  SQD  moving  to  vicinity  BLDGC  and  J1 
to  observe  civilians  departing  along  route. 


1st  deployed  SQD  reports  mob 
has  turned  violent.  One  of  his  ■ 
soldiers  is  injured. 


■Continued  on  next  page 


Legend 

☆  Options 


I  I  Event/Action 
Q  SAGATHalt 


Scenario  A:  SASOCivil  Disturbance,  2d  PIT  Mission  (Continued) 
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Scenario  B:  Company  Assault 

1.  Co  A,  1-1 1th  Infantry  is  conducting  a  company  assault  on  the  town  of 
Kenna.  The  company  is  attacking  the  town  from  north  to  south.  The  initial 
assault  was  successful.  The  1st  Platoon  attacked  the  H-series  buildings 
and  has  successfully  cleared  BLDGs  J2  and  the  l-series  buildings.  They 
are  currently  in  the  l-series  building  preparing  to  assault  the  E-series 
buildings.  Their  follow-on  objectives  are  BLDGs  N  and  P3.  The  3d  Platoon 
successfully  attacked  and  cleared  BLDGs  PI,  P4,  and  C.  They  are 
currently  in  BLDG  C,  preparing  to  attack  BLDG  P2.  Their  follow-on 
objective  is  BLDG  P5. 

2.  The  2d  Platoon,  your  platoon,  is  in  the  center.  Your  platoon  has 
successfully  cleared  the  G-series  buildings  and  is  currently  located  in 
BLDG  L.  You  are  at  100%  strength.  You  are  preparing  to  assault  BLDGs 
A4  then  A3,  A2,  and  A1  respectively.  The  commander  has  directed  you  to 
observe  the  assault  from  a  vantage  point  from  the  2d  floor  of  BLDG  L. 

Your  platoon  has  3  rifle  squads  and  1  weapons  squad.  The  Weapons 
Squad  Leader,  SSG  Castro,  is  presently  in  the  hospital  recovering  from 
wounds.  Since  the  Weapons  Squad  has  no  team  leaders,  you  have 
attached  the  Weapons  Squad  to  the  3  line  squads.  There  are  no  other 
attachments  to  the  platoon. 

3.  The  enemy  is  expected  to  provide  stiff  resistance  as  he  withdraws  his 
forces  to  follow-on  positions  to  the  southern  part  of  town.  The  enemy  is 
estimated  at  platoon  strength.  He  has  mortars,  but  has  not  yet  employed 
them.  He  is  fighting  from  well-fortified,  prepared  positions. 

4.  Ration  cycle  is  C,  C,  T.  MEDEVAC  is  restricted  to  escorted  ground 
ambulances.  Ambulances  are  coordinated  through  the  company 
commander.  Injured  civilians  will  receive  medical  assistance.  Captured 
enemy  personnel  or  civilian  detainees  will  be  handled  through  company 
channels. 

5.  Rules  of  Engagement  (ROE).  Since  the  local  civilian  population  is 
considered  friendly,  the  rules  of  engagement  are  very  restrictive.  There  will 
be  no  weapon  firing  within  the  town  limits  except  against  confirmed  enemy 
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locations.  Targets  must  be  clearly  identified  as  hostile.  Every  effort  must 
be  made  to  avoid  civilian  casualties.  Explosives  cannot  be  used  without 
permission  of  the  company  commander.  Weapons  control  status  is  yellow. 


6.  Your  immediate  task  is  to  plan  the  assault  on  BLDG  A4  and  brief  your 
squad  leaders. 

7.  What  are  your  questions? 

8.  The  scenario  will  begin  when  you  occupy  the  vantage  point  in  BLDG  L. 
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Scenario  B:  Company  Assault  2d  PLT  Mission  from  BLDG  L  to  A4 

AS  OF  6  Jul  2000 


SET-UP 

1.  Enemy  machine  gun  in  NE  comer  of  BLDG  P2  orientated  NW  to  N. 

2.  Need  1  small  hole  blown  in  N  side  of  BLDG  A4  (see  computer  cue), 

3.  Need  second  hole  blown  adjacent  to  1st  hole.  The  combinatioof  the  two  will  make  a  hole  large  enough  for  soldiers  to  enter  the  BLDG  (see  computer  cue). 

4.  Need  machine  gun  audio  2  times  (see  computer  cue  and  scenaritor  effectiveness). 

5.  Need  4  dead  avilians  /nBLDG  A4  w/marked  chemical  containers  located  on  the  floor,  in  adjacent  room  to  the  (entry  point).  Need  abandoned  enemy  tantog 
beside  the  east  side  of  BUDG  A4. 


Initial  assaults  went  well.  PLT 
is  currently  in  BLDG  L  ready  to 
assault  BLDG  A.  PLT  LDR  is 
at  vantage  point  on  2d  floor  of 
BLDG  L.  Scenano  begins  with 
PLT  ordering  1  SQD  to 
conduct  breach  of  BLDG  A. 


Initial  breach  element 
assaults.  3  of  4  soldiers 
KIA  in  street  by  machine 
gun  in  P2  (3d  PLT  OBJ). 
Last  man  makes  it  to  SW 
side  of  BLDG  L 
wounded. 


Unit  is  A  CO  1/11  INF 

1st  PLT  Assaults  from  BLDG  1  to  E 

2d  PLT  Assaults  from  BLDG  L  to  A 

3d  PLT  Assaults  from  BLDG  C  to  P2 

Cannot  use  explosives  w/o  permission 

ofCDR. 

Ea  PLT;  3  nfle  SQDs  &  1  WPNs  SQD 
1st  SQD  LDR  w/PLT  <20  days 
No  other  attachments 
Heavy  enemy  presence 
No  heavy  threat 

Civilian  population  overall  friendly 
CDR  informs  LT  of  vantage  point  on  2d 
floor,  south  side  of  BLDG  L. 


COMPUTER  CUE:  Show  4 
soldiers  running  from  L.  out  into 
the  street.  3  die.  1  moves  SW 
comer  of  BLDG  L.  Play  machine 
gun  audio  simultaneously.  Note 
effectiveness 


la.  PLT  LDR  fails 
to  report  to  CDR 

CDR  requests  STREP. 

Points  out  that  this 
situation  requires  strict 
reporting  procedures. 


1  b.  Requests  smoke 
mission  from  CDR, 


CDR  states  no 
mortars  or  smoke 
grenades  are 
available  at  this 
time. 


If. 

Successfully 
completes 
task  not 
anticipated. 


1c.  Attempts  to  call 
1st  and  3d  PLTsto 
coordinate  for 
suppression. 

I 

CDR  states  commois 
major  problem.  He 
will  relay  messages 
between  PLTs.  Wait 
out. 


1d,  Fails  to  call 
1st  and  3d  PLTs 
to  coordinate  for 
suppression. 


1.  CDR  asks  for  SITREP. 

2.  CDR  again  asks  for  SITREP. 

3.  CDR  repeats  order. 


FREEZE  FRAME  CDR  guidance  ! 


I  calls  and  makes  report. 


1.  Reports  to  CDR. 

2.  Request  smoke  mission. 

3.  Coordinate  w/1  St  and  3d  PLTs 
for  suppression 

4.  Obtain  status  of  WlA 


1e.  Status 
of  WlA. 


1g.  Completes 
all  tasks. 


CDR  calls. 

1st  &  3d 

PLTs  will  SU| 

□press 

when  2d  PL 

T  begins 

its  firing. 

Contacts  PSG 
or  SQD  LDR  to 
get  WlA  status. 


PSG  reports 
WlA  Slightly 
wounded. 
MEDEVAC 


guidance  '  'vitutvAu 
_r _ not  required. 


Fails  to  get  WlA  status. 

PSG  reports  WlA 
gut  Shot.  Doesn't 
think  WlA  will 
make  it.  Requests 
MEDEVAC 

Calls  CDR  for 
MEDEVAC 


•  CDR 
I  guidance 


1.  COR  asks  for  SITREP. 

2.  CDR  again  asks  for  SITREP, 

3.  COR  repeats  order. 


Fails  or  hesitates / 
to  act  / 


1.  PLT  LDR  issues  FRAGO  for  2d  assault. 

2.  Coordinates  actions  of  other  PLTs  with  CDR. 


CDR  states  1st  &  3d  PLTs  r^ortinq  heavy 
enemy  resistance.  Tells  3d  PLT  LDR  to 
suppress  MG  in  BLDG  P2.  1st  &  2d  PLTs  to 
again  assault  BLDGs  E  and  A4.  respectively. 
Don’t  hesitate  in  street-  blow  entries 
w/Javelins.  Wants  PLT  LDRsto  let  him  know 
when  ready  so  he  can  coordinate  w/other 
PLTs. 


AAR  NOTE:  Minimum  FRAGO  should  include  identification  of  breadliM,  PLT  (-)  provides  suppression  fires, 
order  of  movement.  WPNS  SQD  instructed  to  fire  Javelin.  Coordinate  w/CDR  for  actions  of  other  PLT. 


2a.  Fails  to  coordinate 
w/CDR  for  actions  of 
other  PLTs. 


2b.  FRAGO  does  not  discuss  ID  of  breach  TM,  PLT  0 
provides  suppression  fires,  order  of  movement,  WPNS 
SQD  instructed  to  fire  Javelin 


2c.  Successfully 
completes  task 
not  anticipated. 


2d.  Completes 
all  tasks. 


CDR  asks  for  SITREP.  Reminds 
LT  to  call  when  ready  so  he  can 
coordinate  1  st  and  3d  PLT  fires 


PSG  reminds  LT  to  discuss  omitted  portion. 


PLT  begins  2d  assault 


COMPUTER  CUE:  Leave  dead  bodies  in  place.  Create  two  loud  explosions  to  simulate  Javelin  firing  &  impact.  Show  breach 
TM  (4  personnel)  moving  to  assault  BLDG  A4.  Play  machine  gun  audio.  Javelin  hole  ndirge  enough  for  manned  entry  in 
exterior  wall.  Entry  fails,  breach  TM  survives  but  moves  to  road  at  SW  comer  of  BLDCTBetweeBLDGs  L  and  J2. 


Assault  fails  to  gain  an  entry. 
Breach  force  survives,  but  is 
hiding  at  comer  of  BLDG  L. 


in  event  PLT  LDR  fails  to  see  assault,  PSG  reports  that 
the  assault  failed  to  gain  an  entry.  Breach  foxe  has 
survived,  but  is  hiding  in  the  alley  between  BLDGl  & 
J2.  SQD  LDR  is  with  breach  TM.  Haxommo  with  PLT. 


CDR  asks  for  SITREP,  States  1st  PLT  LDR  reports  loosing  all  of  his  breach  force.  Orders  2d  PLT 
to  assault  again.  Use  another  Javelin  to  create  breach.  3d  PLTvill  support  by  fire. 


PLT  LDR  issues  FRAGO  about  another  assault. 
Coordinates  actions  of  other  PLTswith  CDR. 


Continued  on  next  page 


Legend 

☆  Options 


I. . :  Critical  Input 

Decision  Point 
I  I  Event/Action 
Q  SAGATHalt 
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Scenario  B:  Company  Assault  2d  PLT  Mission  from  BLDG  L  to  A4 


PLT  begins  3d  assault 


COMPUTER  CUE;  Leave  dead  bodies  in  place  from  earlier  attemptKeep  2d  breach  TM 
next  to  BLDG  L.  Create  two  sets  loud  explosions  dose  together  to  simulate  Javelins  firing  &, 
impact.  Show  breach  TM  (4)  moving  to  assault  BLDG  A4.  Play  machine  gun  audio.  Retain 
original  Javelin  Holes  but  increase  size  for  manned  entry  in  exterior  wall.  Breach  TM  gains 
entry  into  building  through  breach  holes.  Hava  4  dead  civilianan  adjacent  room  to  entry 
point  in  BLDG  A4.  Have  2  leaking  chemical  agent  containers  in  same  room  as  dead  dvilians 
in  BLDG  A4.  Have  1  abandoned  enemy  tank  in  or  beside  the  E  sidef  BLDG  A4.  Show 
remaining  SQD  members  entering  building  after  breaching  team  to  indude  2d  breaching 
team  from  SW  comer  of  BLDG  L. 


Breach  TM  gains  entry.  Remaining  SQD  members  follow  breach  element  into  building. 


Legend 

☆  Options 


Cues 

Critical  Input 


Decision  Point 
[  I  Event/Action 

o  SAGAT  Halt 
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Appendix  N 

Scenario  C:  Defend  Town 

1 .  Co  A,  1-11th  Infantry  is  in  the  first  day  of  occupying  the  town  of  Kenna. 
The  company  has  the  mission  to  defend  the  town.  The  enemy  presence  is 
considered  light,  capable  of  conducting  military  operations  in  the  immediate 
region  with  forces  less  than  company-size,  supported  by  mortars.  There  is 
no  heavy  threat.  Last  reported  enemy  activity  in  the  region  was  a  platoon¬ 
sized  raid  conducted  in  the  neighboring  town  of  Polo,  3  kilometers  to  the 
northwest,  2  nights  ago.  The  town  population  of  Kenna  is  considered  to  be 
friendly.  However,  there  may  be  insurgents  and  insurgent  sympathizers 
within  the  town's  population. 

2.  The  company  has  established  a  defensive  perimeter  with  1st  Platoon 
defending  in  the  southeast  quadrant  of  the  town  from  BLDGs  P5,  P2.  and 
A1 .  Your  platoon,  the  2d  Platoon,  defends  the  southwest  quadrant  of  the 
town  from  BLDGs  la-ld,  Ea,  and  P3.  3d  PLT  defends  the  northwest 
quadrant  from  BLDGs  H,  G,  and  J1 .  Company  A  Mortars  defends  the 
northeast  quadrant  from  BLDGs  P1  and  PA.  The  company  CP  is  located  in 
the  north  side  BLDG  A4. 

3.  Your  platoon  has  3  rifle  squads  and  1  weapons  squad.  The  Weapons 
Squad  Leader,  SSG  Castro,  is  presently  in  the  hospital  recovering  from 
wounds.  Since  the  Weapons  Squad  has  no  team  leaders,  you  have 
attached  the  Weapons  Squad  to  the  3d  Squad  to  take  advantage  of  the 
height  of  Building  Id.  There  are  no  attachments  to  the  platoon. 

4.  The  2d  Platoon  has  been  in  position  for  6  hours.  The  squads  are 
positioned  as  shown  in  the  accompanying  graphic.  The  company 
commander  selected  the  north  side  of  BLDG  P3  for  the  2d  Platoon  CP.  He 
has  directed  that  all  platoon  leaders  remain  in  the  general  vicinity  of  their 
respective  CPs  for  communications  purposes.  He  has  directed  that  the 
platoons  use  their  platoon  sergeants  as  much  as  possible  to  realign 
positions,  if  necessary. 

5.  Ration  cycle  is  C,  C,  A.  MEDEVAC  is  restricted  to  escorted  ground 
ambulances.  Ambulances  are  coordinated  through  the  company 
commander.  Injured  civilians  will  receive  medical  assistance.  Captured 
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enemy  personnel  or  civilian  detainees  will  be  handled  through  company 
channels. 

6.  Rules  of  Engagement  (ROE).  Since  the  overall  town  population  is 
considered  friendly,  the  rules  of  engagement  are  very  restrictive.  There  will 
be  no  weapon  firing  within  the  town  limits  except  in  self-defense  or  in 
defense  of  the  town  against  a  confirmed  enemy  presence.  Self-defense  is 
defined  as  a  serious  threat  to  life  or  limb.  A  serious  threat  is  considered 
gunfire  or  the  presence  of  an  uncontrolled  mob  armed  with  life-threatening 
weapons  such  as  knives,  pikes,  metal  poles,  etc.  Every  effort  must  be 
made  to  disarm  the  situation  prior  to  the  use  of  deadly  force.  Weapons 
control  status  is  white. 

7.  Your  immediate  task  is  to  brief  your  squad  leaders  as  to  the  current 
situation. 

8.  What  are  your  questions? 

8.  The  scenario  will  begin  when  you  have  returned  to  your  CP  location  and 
receive  a  radio  transmission  from  the  company  commander. 
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Scenario  C:  Defend  Town,  2d  PLT  Mission 


As  of  6  Jui  00 


Unit  is  Co  A.  1-1 1th  Inf 

1st  PLT  defends BLDGs  P5.  P2,  A1 

2d  PLT  defendsBLDGs  i,  Ea.  &  P3 

3d  PLT  defendsBLDGs  H,  G.  J1 

Mortar  PLT  defendsBLDGs  PI .  P4 

Ea  PLT:3rifleSQDs&1  WPNs 

SQD 

PLT  CP  mandated  by  CO  CDR  at 

north  side  of  BLDG  P3 

1st  SQD  LDR  w/PLT  <20  days 

No  other  attachments 

Light  enemy  presence 

No  heavy  threat 

Population  friendly 

MEDEVAC  via  ground  mode  thru 

CDR 

CO  CP  north  side  BLDG  A4 


CDR  tells  PLT  LDR 
that  3d  PLT  has 
reported  enemy  siting. 
Orders  2d  PLT  to 
send  SQD  to  reinforce 
3d  PLT.  SQD  to 
report  to  BLDG  J2. 


1 .  PLT  LDR  should  not 
send  1st  SQD  LDR- 
inexperienced. 

3.  If  1st  SQD  is  tasked,  at 
+3  minutes  be  prepared  to 
get  lost  in  1st  PLT  sector 
but  report  you  are  in 
position  in  3d  PLT  sector. 
Report  is  onlysent  if  PLT 
LDR  requires  report  once 
you  are  in  position,  if  not, 
radio  silence  unless  called. 


- - ►  1 .  CDR  asks  for  SITREP. 

Fails  or  2.  CDR  again  asks  for  SITREP. 
hesitates  3.  CDR  repeats  order, 

\  to  act  - 


CDR  guidance  i 

1.  PLT  LDR  sends  FRAGO  to  tasked  SQD 

2.  Readjusts  positions  vr/remainin^QDs 

3.  Requires  report  on  linkup  w/3d  PLT  -4- 

4.  Notifies  CO  CDR  of  movement 


SQD  LDR 
acknowledges 
FRAGO. 


COMPUTER  CUE:  Show 
movement  of  SQD  to  BLDG 
J2IAWC5. 


la.  Fails  to 
notify  CDR  of 
movement. 


CDR  asks 
for  SITREP. 
Gets  report. 
Reminds  LT 
of  reporting 
requirement 


1c.  Fails  to 
readjust 
remaining 
SQDs 


PSG 

recommends 
repositioning 
forces  unless 
3d  SQD  is 
selected. 
WPNS  SQD 
remains 


Snm  %iSf 

up  report  anticipated.  w/2dor3d 
- 1 - 'I - ^1— —  SQD 


SQD  LDR 
acknowledges 
FRAGO. 


COMPUTER  CUE: 
Show  movement  of 
SQD  to  BLDG  J2 


_ _ •  i 

1 

1 _ 

— - - ■ 

i  IAWC5.  1 

COMPUTER  CUE:  Be 
prepared  to  show  move¬ 
ment  of  selected  SQD  to 
north  side  of  BLDG  J2. 

At  +3  min,  CDR 
calls  with  report 
that  a  2d  PLT 
SQD  is  lost  in  1st 
PLT  sector 

- ► 

.  t 

+2  minutes  calls. 
Reports  contact 
w/3d  PLT  LDR 

Legend 

☆  Options 


J  Criticai  input 


Decision  Point 


I  ~|  Event/Action 

o  SAGAT  Halt 


COR  guidance  I 


/  PLT  \ 
LDR  Vs 

.  actionA 
\  2  /  ! 


FREEZE  FRAME  h 


SQD  LDR  reports  that  he  was  disoriented 
but  1st  PLT  LDR  set  him  straight  and  that 
he  is  enrouteto  3d  PLT  sector. 


T 

FREEZE  ◄- 

1.  CDR  asks  for  SITREP. 

2.  CDR  again  asks  for  SITREP. 

FRAME 

3.  CDR  repeats  order, 

1.  Sends  Javelin  TM  from  WPNS  SQD,  not  rifle  team, 

2.  Readjusts  positions  w/remaining  SQDs. 

3.  Requires  SQD  report  linkup  with  3d  PLT, 

4.  Notifies  CDR  of  movement 


CDR  guidance  J 


Fails  or  hesitates/ 
to  act  / „ 


Sends  \ ' 
reinforcementsX 


+1  minute  later  SQD  LDR  calls  and 
reports  contact  w/3d  PLT  LDR. 


CDR  reports  3d  PLT 
siting  2  enemy  tanks. 
CDR  tells  2d  PLT  LDR 
to  send  1  AT  TM  to 
immediately  reinforce 
3d  PLT. 


3f.  Completes  all  tasks  and  sends  Javelin  TM. 


3a.  Fails  to 

3b.  Fails 

3c.  Fails  to 

notify  CDR 

to 

require 

of 

readjust 

report  of 

movement. 

remaining 

link-up 

1 

SQDs 

w/3d  PLT 

CDR  asks 
for  SITREP, 
Gets  report. 
Reminds  LT 
about 
reporting. 


j  3e,  Successfully  completes  action  not  anticipated. 


i  3d.  Sends 
;  rifle  team. 


PSG  recom¬ 
mends 
repositioning 


PSG  recom¬ 
mends 
reporting  link¬ 
up  using 
detached 
SQD  radio  to 
make  report. 


PSG  provides 
guidance  on 
sending  AT  TM. 
CDR  stated  he 
needs  AT  TM, 
not  fire  team 


//\ Fails  or  hesitates 

plt\ 

LDR  \4 - 

^  ACTION/ 


FREEZE  FRAME  h 


/ 

V  Sends 

I  ATTM 

Tasked  SQD 
reports 

departure  of  ■ 

ATTM  at  +  1 
minute. 

Tasked  SQD 
reports  return 
of  fire  team 
and  adjusting 
perimeter  at 
+3  minutes. 


CDR  reports  1st 
PLT  spotted  3 
dismounted 
OPFOR  in  wood 
line  SW  of 
current  company 
position. 


Continued  on  Next  Page 


N-3 


Scenario  C:  Defend  Town,  2d  PLT  Mission  (Continued) 

As  of  6  July  00  ^  .  r  ^ 

Continued  from  previous  page - (2)— | 

I  COMPUTER  CUE;  Place  5-6  civilians  milling  around  the  south  side  of  church,  BLDG  N.  j . 


CDR  asks  for  SITREP  on  reportj, 
of  possible  civil  disturbance  1 

.  5a.  Fails  to  notify 
CDR. 

. 

soldiers  to  assign  someone  ?—  SQDs  instructions  f 
to  watch  civilians  about  watching  rear. 


PSG  recommends 
stressing  ROE. 


5c.  Does  not  warn 
troops  of  status  of 
civilians 


CDR  disapproves  request  I -  Requests 

. . . ;  reinforcements. 

5e.  Successfully  completes  action  not  anticipated. 


5f,  Completes  all  tasks  including  warns  troops- 
no  firing  on  potentially  friendly  civilians 


CDR  guidance  I 


A  2d  PLT  SQD  LDR  reports  that  a  crowd  of  5 
or  6  civilians  is  forming  on  south  side  of 
church  to  his  immediate  rear.  They  appear 
hostile.  Priority  of  call  will  come  from  SQD 
LDR  3,  2. 1  in  order. 


1.  PSG  recommends  reporting  to 
CDR, 

2.  Finally.  CDR  asks  for  SiTREP. 


1.  Notifies  CO  CDR  of  situation  and  requests 
guidance 

2.  Gives  subordinates  instructions  about 
keeping  alert  and  assigning  someone  to  watch 
their  rear 

3.  Warns  troops  to  not  firing  on  potentially 
friendly  civilians 

4.  Possibly  requests  reinforcements 


Fails  or  hesitates  y 
to  act  y\. 

/  plt\ 

- ^  LDR 

nXACTION/ 

^  Takes  Action  \/ 


COMPUTER  CUE;  Two  shots  fired  at  close  range.  One  of  civilian§alls  to  the  ground. 


Soldier  shoots  civilian  in  retaliation  for  civilian  throwing  a  rock. 


• . <;  If  LT  does  not  see  event,  a  SQD  LDR  reports  civilian  shot  for  throwing  rocks.  Priority  of  call  goes  to  SQD  LDR  1 . 2,  i 

1-;  PSG  reports  he  and  medic  are  enrouteto  aid  the  injured  civilian.! 

l-i  COMPUTER  CUE;  Requires  2  SAF  personnel.  Medic  and  PSG  come  from  south  side  of  BLDG  Ea  to  aid  civilian  shot  on  south  side  oflHH  N. 
Fails  or  hesitates  to  act  w !  ^  recommends  reporting  to  CDR.j  I  pppp7p  '""j - - 


1 ,  PSG  recommends  reporting  to  CDR.j 

2.  CDR  calls  for  cease  nre  and  wants  r 

shooting  investigated.  i 


CDR  guidance 


_ ;  f  •  Calls  for  cease  fire  on  PLT  net 
^  2.  Notifies  CO  CDR  of  situation 

aKes  action  3  Gives  subordinates  instnjctions. 
4.  Requests  MEDEVAC. 


6a.  Fails  to  notify  CDR  of  situation  or 
request  MEDEVAC. 


6b.  Obtains  civilian's  status  from  PSG. 
Shoulder  wound-  not  serious. 


6c.  Fails  to  call  for  cease  fire. 


■  PSG  reports  civilian  KIA  but 
could  have  survived  w/MEDEVAC. 


Notifies  CDR  &  Requests  MEDEVAC. 

Jpso'caiirforcease'firel _ 


COMPUTER  CUE;  Burst  of 
machine  gun  fire  in  distance. 


PSG  calls 
cease  fire. 


CDR  calls. 
Wants  SITREP. 


7b.  Fails  to  call 
for  cease  fire. 


6d.  Fails  to  give  SQDs  _  COR  wants  SITREP.  Also  how  civilian  is  killed 

instructions. _  when  he  gave  guidance  on  civilians  being  friendly. ' 

6e.  Successfully  completes  task  not  anticipated.  — _ 

I  6f  Completes  all  tasks.  I - - - — - 


CDR  calls.  1st  PLT  reports  10-15  civilians  leaving  towri 


PSG  tells  SQDs  to  keep 
their  people  down  until 
we  can  stop  the  firing. 


7c.  Fails  to 
pive  SQDs 
instnjctions. 


7d.  Successfully  completes  task 
not  anticipated. 


1 .  Calls  for  cease  fire. 

2.  Notifies  CDR  of  situation 

3.  Gives  subordinates 
instructions. 


A  2d  PLT  SQD 
LDR  reports  his 
Alpha  TM  SAW 
gunner  is  KIA 
from  fire  from 
1st  PLT  sector. 
Priority  of  call  ; 
2,1,3.  i 


_ 1 

CDR  calls.  Notifies  2d  PLT  of  fratricide 

7e.  Completes  all  tasks. 

firing  from  1st  PLT.  Orders  all  company 
elements  to  cease  fire. 

Appendix  O 


Scenario  D:  Secure  Village;  React  to  Downed  Aircraft 

1 .  Co  A,  1-11  th  Infantry  is  conducting  platoon-sized  defenses  of  3  villages. 
The  commander  is  located  in  the  village  of  Polo.  He  has  directed  that  the 
platoons  establish  and  maintain  checkpoints  in  each  of  the  villages.  Each 
platoon  is  to  employ  a  roving  patrol  for  additional  security,  as  needed.  1st 
Platoon  is  securing  the  village  of  Polo,  3  kilometers  to  the  northeast.  3d 
Platoon  is  securing  the  village  of  Tuskin,  3  kilometers  to  your  south. 
Company  C,  1-1 1th  Infantry  is  the  battalion  reaction  force. 

2.  The  2d  Platoon,  your  platoon,  is  securing  the  village  of  Kenna.  The 
town  population  of  Kenna  is  considered  to  be  friendly.  However,  there  may 
be  insurgents  and  insurgent  sympathizers  within  the  town's  population.  To 
secure  Kenna,  you  have  established  two  checkpoints.  1st  Squad  is  at 
Checkpoint  North,  located  at  the  road  intersection  between  BLDGs  Gc  and 
J1.  2d  Squad  is  at  Checkpoint  South,  located  due  south  of  BLDG  A4.  Both 
checkpoints  block  the  major  route  into  the  village.  The  3d  Squad  is 
collocated  with  the  platoon  CP  in  BLDG  C,  the  jail.  3d  Squad  is  preparing 
to  conduct  a  roving  patrol  of  the  village.  The  Weapons  Squad  has  been 
detached  to  the  village  of  Polo  to  train  local  police  on  the  use  of  heavy 
weapons.  There  are  no  other  attachments  to  the  platoon. 

3.  The  enemy  presence  is  considered  light,  capable  of  conducting  military 
operations  in  the  immediate  region  with  forces  less  than  platoon-size, 
supported  by  mortars.  There  is  no  heavy  threat.  Last  reported  enemy 
activity  in  the  region  was  a  platoon-sized  raid  conducted  in  the  neighboring 
town  of  Polo,  3  kilometers  to  the  northwest,  2  nights  ago. 

4.  Ration  cycle  is  C,  C,  T.  MEDEVAC  is  restricted  to  escorted  ground 
ambulances.  Ambulances  are  coordinated  through  the  company 
commander.  Injured  civilians  will  receive  medical  assistance.  Captured 
enemy  personnel  or  civilian  detainees  will  be  handled  through  company 
channels. 

5.  Rules  of  Engagement  (ROE).  Since  the  overall  town  population  is 
considered  friendly,  the  rules  of  engagement  are  very  restrictive.  There  will 
be  no  weapon  firing  within  the  town  limits  except  against  confirmed  enemy 
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locations.  Targets  must  be  clearly  identified  as  hostile.  Every  effort  must 
be  made  to  reduce  or  eliminate  civilian  casualties.  Weapons  control  status 
is  white. 

6.  Your  immediate  task  is  to  brief  your  squad  leaders  on  the  current 
situation. 

7.  What  are  your  questions? 

8.  The  scenario  will  begin  when  you  occupy  the  platoon  CP  in  BLDG  C. 
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Scenario  D:  Secure  Village;  React  to  Downed  Aircraft 


PLT  LDR  Receives 
OPORD.  PLT  is  in 
security  positions 


1st  PLT  secures  village  of  Polio. 

2cl  PLT  secures  village  of  Kenna. 

3d  PLT  secures  village  of  Tuskin. 
Concept:  Occupy  major  routes  into 
villages  with  squad.  Checkpoints 
must  be  maintained.  Provide  roving 
patrols  for  security,  as  needed. 

Ea  PLT:  3  rifle  SQDs.  All  WPNS 
SQDs  detached  to  train  local  police 
on  use  of  heavy  weapons. 


Scenario  begins 
w/lst  SQO  at 
North  Checkpoint 
and  2d  SQD  at 
South  Check¬ 
point.  3d  SQD 
w/PLT  CP  at  jail 
(BLDG  C),  pre¬ 
paring  to  conduct 
routine  patrol  to 
radio  station.  All 
SQDS  at  50% 
alert  status. 


All  SQDS  report  area 
secure  nothing  to  report. 


3rd  SQD  reports  its  1  st  SQD  -reports  smoke  rising  from 
preparing  to  depart  in  —  West  beyond  village  -240° . 

3  to  5  minutes.  Civilians  in  street  looking  West. 


COMPLITERCUE:  A/C 
can  be  heard  flying  East  to 
West,  just  south  of  town. 
Once  dear  of  town.  2  loud 
explosions  heard.  A/C  falls 
from  sky. 


COMPLITERCUE:  Plume 
of  smoke  west  of  town  (A/C 
crash  site).  6-8  civilians 
gathered  in  street  between 
BLDGsH&l  looking  West 
at  smoke. 


CDR  calls.  Has  received  report 
of  possible  downed  aircraft. 
Investigate  situation,  however, 
PLT  LljR  should  stay  at  present 
location  to  focus  on  primary 
mission.  1st  PLT  reports 
unidentified  gang  activity  at 
POLO.  Report  states  power 
substation  at  POLO  destroyed. 


1.  CDR  asks  for  SITREP. 

2.  CDR  again  asks  for 
SITREP. 

3.  CDR  repeats  order. 


1a.  Fails  to 
report  to  CDR. 


CDR  requests 
SITREP. 
Reminds  LT 
that  he  doesn’t 
know  what  the 
LT  is  doing 
unless  he  tells 
him! 


1b.  Fails  to 
increase  alert 
status. 


PSG  recom¬ 
mends  100% 
alert  status 
based  on 
CDR’s 
warning 


1c.  Fails  to  send 
3d  SQD  or  tries  to 
send  another 
element. 


□I 


PSG  recommends  3d 
SQD  since  they  are 
preparing  to  move. 
Points  out  this  is  a 
SQD  mission. 


L .  .  I  -  »)  FREEZE  FRAME 


1.  SITREP  to  CDR, 

2.  Increase  alert  status  of  SQDs  (No  alert  will  delay  future 
actions.) 

3.  Directs  3rd  SQD  patrol  to  move  West  and  report  findings. 


Fails  or  hesitates/ 
to  act 

PLT' 
LDR 
ACTION 
1 


If  LT  persists,  CDR  calls.  Requests  3d 
SQD  LDR  conduct  downed  A/C  mission 
since  he  speaks  local  language. 


1.  CDR  asks  for  SITREP. 

2.  CDR  again  asks  for  SITREP. 

3.  CDR  repeats  order. 


Id.  Successfully 
completes 
unanticipated 
task. 

1e.  Completes 
all  tasks. 

r 

r 

COMPUTER  CUE:  3  slow  moving 

civilian  trucks  approaching  East  i . 1 

edge  of  runway  from  NE 

COMPUTER  CUE:  US  /\/C  on  fire  crash  site  300m 
West  of  town.  Plume  of  smoke  at  A/C  crash  site.  3 
wounded  military  at  crash  site.  2  civilians  walking 
from  BLDG  E  West  to  crash  site 


3d  SQD  LDR  reports  downed  US  helicopter,  300 
meters  West  of  village.  AC  on  fire.  Can  observe  2 
to  3  casualties  outside  of  aircraft.  2  civilians  moving 
West  toward  AC:  others  continuing  to  observe  from 
village.  Will  follow-up  once  on  site. 


CDR  guidance 


1 .  Reports  info  on  crash  site  to  CDR, 

2.  Reports  info  on  truck  movements  to  CDR. 

3.  Updates  SQDs  on  situation  provided  by  CDR. 

4.  Advises  SQDs  on  ROE. 


CDR  confirms  1st  PLT  report  of  unidentified  gang 
destroying  power  substation  vicInityPollo.  Gang  of 
40  departed  South  in  cars  and  trucks. 


1st  SQD  reports  3  unidentified  civilian  trucks  approaching 
East  edge  of  runway  from  NE.  Moving  very  slowly. 


2a.  Fails  to  report  crash  info  to  CDR. 


CDR  calls.  Demands  SITREP.  Wants 
to  know  PLT  LDRs’ locations  at  all 
times.  If  moving  to  crash  site  reminds 
PLT  LDR  of  pnmary  mission-  secure 
village! 


2b.  Fails  to 

2c.  Fails  to 

report  trucks 
to  CDR. 

inform  PLT. 

""x . 

PSG  reminds 
LT  to  cal! 
CDR. 


PSG  asks 
LT  for  a 
SITREP. 


X 


2d.  Successfully 
completes 
unanticipated 
task. 


2e.  Completes 
all  tasks. 


CDR  calls.  Directs  to  keep 
trucks  under  observation. 
RemindSQDsof  ROE.  Gang 
reported  to  be  3540  civilian 
males,  some  with  small  arms. 


COMPUTER  CUE:  Continue  burning  A/C  w/plume  of  smoke  at  crash  site.  Show  3 
wounded  SAF  at  crash  site.  Show  3  slow  moving  utility  trucks  approaching  SE  edge  c 
runway  and  turning  South  to  road  paralleling  airstrip. 


Legend 

Options 

Cues 

i - -  - 

/V 

1  Criticat  Input 

0 

'  Decision  Point 

]  Event/Action 

o 

SAGAT  Halt 

1st  SQD  reports  trucks  continuing  on  road  South  of  airstrip  moving  West. 
Movement  rate  increased  slightly. 


CDR  directs  A/C  crash  site  be  secured  by  squad  ASAP.  Render  asstance,  if 
needed.  Air  MEDEVAC  available.  BN  has  alerted  reaction  elemertb  assist.  ETA 
45  minutes.  Pnmary  mission  remains  security  of  Kenna.  Update  on  tnjcks? 


CONTINUED  ON  NEXT  PAGE 


0-3 


Scenario  D:  Secure  Village;  React  to  Down  Aircraft 

CONTINUED  FROM  PREVIOUS  PAGE 


1  St  SQD  reports  1  truck  halted  North  of  position  along  road  South  of  airstrip. 
The  other  2  trucks  continued  moving  West  along  road  South  of  asfirip. 


3d  SQD  LDR  reports  site  secure.  4  US  casualties  on  site  A  KIA  ,  3  WlA .  Requests  immediate  MEDEVAC.  2  civilians  attempting  to  pilfer  around 
site  being  detained. 


^  Determines  WlA 
/\  status 


3d  SQD  LDR  reports  3  WiA  “  ® 

are  critical  bum  patients.  pDR  for 

Need  immediate  MEDEVAC.  MEDEVAC 


COMPUTER  CUE:  2  Rifle  shots  from  West  end  of  village. 
Civilians  in  street  run  to  cover.  Sniper  on  roof  of  BLDG  Ic. 


Fails  to  determine 
WIA  status 


3d  SQD  LDR  reports  1  WIA 
has  died.  2  remaining  WlAs 
are  critical  bum  patients. 


5a.  Fails  to 
report  to  CDR. 


CDR  requests 
SITREP 


5b.  Mission  to 
find/eliminate 
sniper  is  not 
passed  to  2d 
SQD. 


If  1st  SQD  is 
tasked,  SQD  LDR 
asks  about  trucks. 


PSG  immediately 
recommends  2d 
SQD  Fire  TM  as 
reaction  force. 
Recommends  he 
be  in  charge. 


5c.  Other  SQD 
not  warned  of 
movement. 


SQD  reports  an 
armed  man 
running  vicinity 
of  church.  SQD 
Request  perniis- 
sion  to  open  fire. 


PSG 

immediately 
confirms  Fire 


If  LT  doesn't  request 
MEDEVAC.  CDR 
calls  for  SITREP. 


1st  SQD  LDR  reports  sound  of  rifle  fire  from 
West  end  of  village.  Civilians  running  to  cover. 
Can  not  determine  source  of  fire. 


3d  SQD  LDR  reports  sniper  fire  from  West  end  of  village.  Possible  roof  or 
upper  floor  of  BLDG  I  or  H.  No  casualties  as  of  this  time.  Position  exposed. 
No  target  to  return  fire. 


1. CDR  asks  for  SITREP. 

2.  CDR  again  asks  for  SITREP. 

3.  CDR  repeats  order. 


CDR  guidance  H 


FREEZE  FRAME 


_ _ 1  - - - 

5d.  Successfully 

5e. 

completes 

Completes 

unanticipated  task. 

all  tasks. 

PSG  reports  tasked  Fire  TM  in  vicinity  of  reported  sniper  location.  No  contact  at  this  time. 


Fails  or  hesitates  ^ 
to  aa  / 


1.  Renders  SITREP  to  CDR. 

2.  Deploys  reaction  force  to  West  end  of 
village. 

3.  Warns  other  SQD  of  reaction  force 
movement. 


Tactical  Options  Available  to 
PLT  LDR  (In  tactical  priority): 

1.  Fire  TM  from  2d  SQD  under 
control  of  PSG. 

2.  Fire  TM  from  2d  SQD. 

3.  Composite  SQD  (1  fire  TM 
ea  SQD)  under  control  of  PSG. 

4.  Fire  team  from  1  st  SQD. 


...I  COMPUTER  CUE:  1  truck  North  of  1st  SQD  at  intersection  at  base  of  hill  stops,  cuts  engine,  honks  horn.  2  other  trucks  continue 
I  westward  to  NE  comer  of  hard  stand  until  they  can  be  obsenred^pSQD  at  crash  site.  They  then  stop  and  cut  engines. 


1st  SQD  reports  1  truck  halted  North  of  position  along  road  South  of  airship.  No  movement  or  engine  noise.  Appears  to  be  waiting  for  someone. 
The  other  2  trucks  are  continuing  to  move  to  the  West  along  theoad  South  of  airstrip. 

PSG  reports  detaining  a  young  male  hiding  behind  boxes  on  top  floor  of  BLDG  I.  Roof  top  clear.  No  weapon  found.  2  7.62mm  shell  casings  fou:  id 
on  roof.  Does  LT  want  search  continued? 


3d  SQD  reports  receiving  no  additional  sniper  fire.  Can  observme  2  trucks  that  headed  West.  They  are  remaining  stationary  .No  movement 
observed  outside  of  vehicles. 


CDR  reports  MEDEVAC  10  minutes  out.  Will  have  15  minutes  of  station  time  on  arrival.  Can  not  land  at  hot  PZ.  Needs  status  of  sniper  &  trucks 
Are  trucks  hostile? 


Fails  or  hesitates 
to  act 


/  PLT\ 
LDR  \  . 
ACTION 
\  6  / 


1.  CDR  asks  for  SITREP. 

2.  CDR  again  asks  for  SITREP. 

3.  CDR  repeats  order. 
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1.  Renders  SITREP  to  CDR. 

2.  Directs  reaction  force  to  continue  search 
for  sniper. 

3.  Informs  3d  SQD  of  inbound  MEDEVAC. 

4.  Alerts  PLT  to  station  time  of  MEDEVAC. 


6a.  Fails  to 
report  to 
CDR. 


CDR 

demands  a 
SITREP 


6b.  Reaction  6c.  Fails  to 

force  not  told  notify  PLT  of 

to  continue  MEDEVAC. 
search.  | - - 

‘  r^\  3d  SQD  LDR 

PSG  requests  requests  status 

to  withdraw  of  MEDEVAC. 

reaction  force.  I _ , _ ^ _ 


3d  SQD  LDR 
requests  status 
of  search  for 
sniper. 


6d. 

Successfully 

completes 

unanticipated 


6e. 

Completes 
all  tasks. 
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